2023-03-07 10:53:29,935 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-03-07 10:53:30,219 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec 2023-03-07 10:53:30,234 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-03-07 10:53:30,235 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/cluster_071bbff6-8e10-d123-7f15-b1e31d2cd3b7, deleteOnExit=true 2023-03-07 10:53:30,235 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-03-07 10:53:30,236 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/test.cache.data in system properties and HBase conf 2023-03-07 10:53:30,236 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/hadoop.tmp.dir in system properties and HBase conf 2023-03-07 10:53:30,236 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/hadoop.log.dir in system properties and HBase conf 2023-03-07 10:53:30,237 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/mapreduce.cluster.local.dir in system properties and HBase conf 2023-03-07 10:53:30,237 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-03-07 10:53:30,237 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-03-07 10:53:30,355 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-03-07 10:53:30,784 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-03-07 10:53:30,789 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-03-07 10:53:30,790 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-03-07 10:53:30,790 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-03-07 10:53:30,791 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-03-07 10:53:30,791 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-03-07 10:53:30,792 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-03-07 10:53:30,792 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-03-07 10:53:30,793 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/dfs.journalnode.edits.dir in system properties and HBase conf 2023-03-07 10:53:30,793 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-03-07 10:53:30,793 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/nfs.dump.dir in system properties and HBase conf 2023-03-07 10:53:30,794 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/java.io.tmpdir in system properties and HBase conf 2023-03-07 10:53:30,794 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/dfs.journalnode.edits.dir in system properties and HBase conf 2023-03-07 10:53:30,795 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-03-07 10:53:30,795 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-03-07 10:53:31,370 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-03-07 10:53:31,374 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-03-07 10:53:31,667 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-03-07 10:53:31,834 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-03-07 10:53:31,848 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-03-07 10:53:31,894 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-03-07 10:53:31,939 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/java.io.tmpdir/Jetty_localhost_33281_hdfs____bihng5/webapp 2023-03-07 10:53:32,075 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33281 2023-03-07 10:53:32,094 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-03-07 10:53:32,095 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-03-07 10:53:32,670 WARN [Listener at localhost/40101] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-03-07 10:53:32,749 WARN [Listener at localhost/40101] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-03-07 10:53:32,773 WARN [Listener at localhost/40101] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-03-07 10:53:32,781 INFO [Listener at localhost/40101] log.Slf4jLog(67): jetty-6.1.26 2023-03-07 10:53:32,787 INFO [Listener at localhost/40101] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/java.io.tmpdir/Jetty_localhost_44121_datanode____.h9xg89/webapp 2023-03-07 10:53:32,893 INFO [Listener at localhost/40101] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44121 2023-03-07 10:53:33,284 WARN [Listener at localhost/42383] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-03-07 10:53:33,806 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe79f8b018826c739: Processing first storage report for DS-1a0e1cde-b8e7-4629-810f-4d688fc3b480 from datanode 4bca1348-168b-4ef4-97fa-db6f7dc39f86 2023-03-07 10:53:33,808 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe79f8b018826c739: from storage DS-1a0e1cde-b8e7-4629-810f-4d688fc3b480 node DatanodeRegistration(127.0.0.1:40929, datanodeUuid=4bca1348-168b-4ef4-97fa-db6f7dc39f86, infoPort=33695, infoSecurePort=0, ipcPort=42383, storageInfo=lv=-57;cid=testClusterID;nsid=734107000;c=1678186411446), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-03-07 10:53:33,809 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe79f8b018826c739: Processing first storage report for DS-a5383b62-f3b5-4b9c-ace6-509a327e746e from datanode 4bca1348-168b-4ef4-97fa-db6f7dc39f86 2023-03-07 10:53:33,809 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe79f8b018826c739: from storage DS-a5383b62-f3b5-4b9c-ace6-509a327e746e node DatanodeRegistration(127.0.0.1:40929, datanodeUuid=4bca1348-168b-4ef4-97fa-db6f7dc39f86, infoPort=33695, infoSecurePort=0, ipcPort=42383, storageInfo=lv=-57;cid=testClusterID;nsid=734107000;c=1678186411446), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-03-07 10:53:33,902 DEBUG [Listener at localhost/42383] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec 2023-03-07 10:53:33,980 INFO [Listener at localhost/42383] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/cluster_071bbff6-8e10-d123-7f15-b1e31d2cd3b7/zookeeper_0, clientPort=56055, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/cluster_071bbff6-8e10-d123-7f15-b1e31d2cd3b7/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/cluster_071bbff6-8e10-d123-7f15-b1e31d2cd3b7/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-03-07 10:53:33,994 INFO [Listener at localhost/42383] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56055 2023-03-07 10:53:34,002 INFO [Listener at localhost/42383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-07 10:53:34,005 INFO [Listener at localhost/42383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-07 10:53:34,686 INFO [Listener at localhost/42383] util.FSUtils(471): Created version file at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f with version=8 2023-03-07 10:53:34,687 INFO [Listener at localhost/42383] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/hbase-staging 2023-03-07 10:53:35,023 INFO [Listener at localhost/42383] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-03-07 10:53:35,510 INFO [Listener at localhost/42383] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-03-07 10:53:35,541 INFO [Listener at localhost/42383] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-07 10:53:35,542 INFO [Listener at localhost/42383] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-03-07 10:53:35,542 INFO [Listener at localhost/42383] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-03-07 10:53:35,542 INFO [Listener at localhost/42383] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-07 10:53:35,542 INFO [Listener at localhost/42383] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-03-07 10:53:35,703 INFO [Listener at localhost/42383] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-03-07 10:53:35,774 DEBUG [Listener at localhost/42383] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-03-07 10:53:35,867 INFO [Listener at localhost/42383] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45579 2023-03-07 10:53:35,877 INFO [Listener at localhost/42383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-07 10:53:35,880 INFO [Listener at localhost/42383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-07 10:53:35,901 INFO [Listener at localhost/42383] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45579 connecting to ZooKeeper ensemble=127.0.0.1:56055 2023-03-07 10:53:35,944 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:455790x0, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-03-07 10:53:35,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:45579-0x100be9c69520000 connected 2023-03-07 10:53:35,977 DEBUG [Listener at localhost/42383] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-07 10:53:35,978 DEBUG [Listener at localhost/42383] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-07 10:53:35,982 DEBUG [Listener at localhost/42383] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-03-07 10:53:35,989 DEBUG [Listener at localhost/42383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45579 2023-03-07 10:53:35,990 DEBUG [Listener at localhost/42383] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45579 2023-03-07 10:53:35,990 DEBUG [Listener at localhost/42383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45579 2023-03-07 10:53:35,991 DEBUG [Listener at localhost/42383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45579 2023-03-07 10:53:35,991 DEBUG [Listener at localhost/42383] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45579 2023-03-07 10:53:35,998 INFO [Listener at localhost/42383] master.HMaster(444): hbase.rootdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f, hbase.cluster.distributed=false 2023-03-07 10:53:36,065 INFO [Listener at localhost/42383] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-03-07 10:53:36,065 INFO [Listener at localhost/42383] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-07 10:53:36,065 INFO [Listener at localhost/42383] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-03-07 10:53:36,066 INFO [Listener at localhost/42383] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-03-07 10:53:36,066 INFO [Listener at localhost/42383] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-07 10:53:36,066 INFO [Listener at localhost/42383] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-03-07 10:53:36,071 INFO [Listener at localhost/42383] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-03-07 10:53:36,074 INFO [Listener at localhost/42383] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39673 2023-03-07 10:53:36,076 INFO [Listener at localhost/42383] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-03-07 10:53:36,082 DEBUG [Listener at localhost/42383] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-03-07 10:53:36,083 INFO [Listener at localhost/42383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-07 10:53:36,086 INFO [Listener at localhost/42383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-07 10:53:36,087 INFO [Listener at localhost/42383] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39673 connecting to ZooKeeper ensemble=127.0.0.1:56055 2023-03-07 10:53:36,091 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:396730x0, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-03-07 10:53:36,092 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39673-0x100be9c69520001 connected 2023-03-07 10:53:36,092 DEBUG [Listener at localhost/42383] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-07 10:53:36,094 DEBUG [Listener at localhost/42383] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-07 10:53:36,095 DEBUG [Listener at localhost/42383] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-03-07 10:53:36,095 DEBUG [Listener at localhost/42383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39673 2023-03-07 10:53:36,095 DEBUG [Listener at localhost/42383] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39673 2023-03-07 10:53:36,096 DEBUG [Listener at localhost/42383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39673 2023-03-07 10:53:36,096 DEBUG [Listener at localhost/42383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39673 2023-03-07 10:53:36,097 DEBUG [Listener at localhost/42383] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39673 2023-03-07 10:53:36,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45579,1678186414835 2023-03-07 10:53:36,110 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-03-07 10:53:36,111 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45579,1678186414835 2023-03-07 10:53:36,130 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-03-07 10:53:36,130 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-03-07 10:53:36,131 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-07 10:53:36,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-03-07 10:53:36,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45579,1678186414835 from backup master directory 2023-03-07 10:53:36,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-03-07 10:53:36,136 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45579,1678186414835 2023-03-07 10:53:36,136 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-03-07 10:53:36,137 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-03-07 10:53:36,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,45579,1678186414835 2023-03-07 10:53:36,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-03-07 10:53:36,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-03-07 10:53:36,231 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/hbase.id with ID: 1c61e50f-b47c-42db-97f0-441bce5bf7cb 2023-03-07 10:53:36,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-07 10:53:36,290 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-07 10:53:36,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7f8b5ed4 to 127.0.0.1:56055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-07 10:53:36,368 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44eafc08, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-07 10:53:36,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-03-07 10:53:36,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-03-07 10:53:36,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-03-07 10:53:36,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-03-07 10:53:36,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-03-07 10:53:36,422 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-03-07 10:53:36,423 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-07 10:53:36,465 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/MasterData/data/master/store-tmp 2023-03-07 10:53:36,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:53:36,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-03-07 10:53:36,493 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-07 10:53:36,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-07 10:53:36,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-03-07 10:53:36,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-07 10:53:36,493 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-07 10:53:36,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-07 10:53:36,495 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/MasterData/WALs/jenkins-hbase4.apache.org,45579,1678186414835 2023-03-07 10:53:36,517 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45579%2C1678186414835, suffix=, logDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/MasterData/WALs/jenkins-hbase4.apache.org,45579,1678186414835, archiveDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/MasterData/oldWALs, maxLogs=10 2023-03-07 10:53:36,575 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40929,DS-1a0e1cde-b8e7-4629-810f-4d688fc3b480,DISK] 2023-03-07 10:53:36,586 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-03-07 10:53:36,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/MasterData/WALs/jenkins-hbase4.apache.org,45579,1678186414835/jenkins-hbase4.apache.org%2C45579%2C1678186414835.1678186416527 2023-03-07 10:53:36,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40929,DS-1a0e1cde-b8e7-4629-810f-4d688fc3b480,DISK]] 2023-03-07 10:53:36,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-03-07 10:53:36,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:53:36,669 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-03-07 10:53:36,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-03-07 10:53:36,730 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-03-07 10:53:36,737 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-03-07 10:53:36,761 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-03-07 10:53:36,774 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:53:36,781 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-03-07 10:53:36,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-03-07 10:53:36,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-03-07 10:53:36,802 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-07 10:53:36,804 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65204379, jitterRate=-0.028379037976264954}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-07 10:53:36,804 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-07 10:53:36,805 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-03-07 10:53:36,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-03-07 10:53:36,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-03-07 10:53:36,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-03-07 10:53:36,830 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-03-07 10:53:36,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 34 msec 2023-03-07 10:53:36,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-03-07 10:53:36,891 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-03-07 10:53:36,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-03-07 10:53:36,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-03-07 10:53:36,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-03-07 10:53:36,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-03-07 10:53:36,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-03-07 10:53:36,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-03-07 10:53:36,948 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-07 10:53:36,949 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-03-07 10:53:36,950 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-03-07 10:53:36,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-03-07 10:53:36,971 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-03-07 10:53:36,971 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-03-07 10:53:36,971 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-07 10:53:36,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,45579,1678186414835, sessionid=0x100be9c69520000, setting cluster-up flag (Was=false) 2023-03-07 10:53:36,988 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-07 10:53:36,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-03-07 10:53:37,001 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45579,1678186414835 2023-03-07 10:53:37,009 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-07 10:53:37,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-03-07 10:53:37,021 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45579,1678186414835 2023-03-07 10:53:37,025 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.hbase-snapshot/.tmp 2023-03-07 10:53:37,102 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(952): ClusterId : 1c61e50f-b47c-42db-97f0-441bce5bf7cb 2023-03-07 10:53:37,107 DEBUG [RS:0;jenkins-hbase4:39673] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-03-07 10:53:37,115 DEBUG [RS:0;jenkins-hbase4:39673] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-03-07 10:53:37,115 DEBUG [RS:0;jenkins-hbase4:39673] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-03-07 10:53:37,119 DEBUG [RS:0;jenkins-hbase4:39673] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-03-07 10:53:37,120 DEBUG [RS:0;jenkins-hbase4:39673] zookeeper.ReadOnlyZKClient(139): Connect 0x1ad01384 to 127.0.0.1:56055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-07 10:53:37,136 DEBUG [RS:0;jenkins-hbase4:39673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1417feae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-07 10:53:37,137 DEBUG [RS:0;jenkins-hbase4:39673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@102878f4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-03-07 10:53:37,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-03-07 10:53:37,163 DEBUG [RS:0;jenkins-hbase4:39673] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39673 2023-03-07 10:53:37,166 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-07 10:53:37,166 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-07 10:53:37,166 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-07 10:53:37,167 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-07 10:53:37,167 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-03-07 10:53:37,167 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-07 10:53:37,167 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-03-07 10:53:37,167 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-07 10:53:37,167 INFO [RS:0;jenkins-hbase4:39673] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-03-07 10:53:37,167 INFO [RS:0;jenkins-hbase4:39673] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-03-07 10:53:37,168 DEBUG [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(1023): About to register with Master. 2023-03-07 10:53:37,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1678186447169 2023-03-07 10:53:37,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-03-07 10:53:37,172 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45579,1678186414835 with isa=jenkins-hbase4.apache.org/172.31.14.131:39673, startcode=1678186416064 2023-03-07 10:53:37,184 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-03-07 10:53:37,185 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-03-07 10:53:37,185 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-03-07 10:53:37,190 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-03-07 10:53:37,193 DEBUG [RS:0;jenkins-hbase4:39673] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-03-07 10:53:37,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-03-07 10:53:37,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-03-07 10:53:37,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-03-07 10:53:37,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-03-07 10:53:37,203 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-03-07 10:53:37,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-03-07 10:53:37,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-03-07 10:53:37,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-03-07 10:53:37,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-03-07 10:53:37,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-03-07 10:53:37,220 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1678186417220,5,FailOnTimeoutGroup] 2023-03-07 10:53:37,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1678186417220,5,FailOnTimeoutGroup] 2023-03-07 10:53:37,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-03-07 10:53:37,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-03-07 10:53:37,223 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-03-07 10:53:37,223 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-03-07 10:53:37,242 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-03-07 10:53:37,243 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-03-07 10:53:37,243 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f 2023-03-07 10:53:37,259 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:53:37,262 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-03-07 10:53:37,263 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43247, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-03-07 10:53:37,265 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/1588230740/info 2023-03-07 10:53:37,266 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-03-07 10:53:37,267 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:53:37,268 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-03-07 10:53:37,270 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/1588230740/rep_barrier 2023-03-07 10:53:37,271 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-03-07 10:53:37,272 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:53:37,272 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-03-07 10:53:37,275 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/1588230740/table 2023-03-07 10:53:37,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:37,276 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-03-07 10:53:37,277 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:53:37,279 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/1588230740 2023-03-07 10:53:37,280 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/1588230740 2023-03-07 10:53:37,284 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-03-07 10:53:37,287 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-03-07 10:53:37,291 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-07 10:53:37,293 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64688723, jitterRate=-0.03606291115283966}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-03-07 10:53:37,293 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-03-07 10:53:37,293 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-03-07 10:53:37,293 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-03-07 10:53:37,293 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-03-07 10:53:37,293 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-03-07 10:53:37,293 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-03-07 10:53:37,294 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-03-07 10:53:37,294 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-03-07 10:53:37,295 DEBUG [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f 2023-03-07 10:53:37,295 DEBUG [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40101 2023-03-07 10:53:37,295 DEBUG [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-03-07 10:53:37,300 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-03-07 10:53:37,300 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-03-07 10:53:37,301 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-07 10:53:37,302 DEBUG [RS:0;jenkins-hbase4:39673] zookeeper.ZKUtil(162): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:37,302 WARN [RS:0;jenkins-hbase4:39673] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-03-07 10:53:37,302 INFO [RS:0;jenkins-hbase4:39673] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-07 10:53:37,303 DEBUG [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/WALs/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:37,304 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39673,1678186416064] 2023-03-07 10:53:37,312 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-03-07 10:53:37,313 DEBUG [RS:0;jenkins-hbase4:39673] zookeeper.ZKUtil(162): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:37,325 DEBUG [RS:0;jenkins-hbase4:39673] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-03-07 10:53:37,326 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-03-07 10:53:37,329 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-03-07 10:53:37,335 INFO [RS:0;jenkins-hbase4:39673] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-03-07 10:53:37,353 INFO [RS:0;jenkins-hbase4:39673] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-03-07 10:53:37,357 INFO [RS:0;jenkins-hbase4:39673] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-07 10:53:37,357 INFO [RS:0;jenkins-hbase4:39673] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-07 10:53:37,358 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-03-07 10:53:37,365 INFO [RS:0;jenkins-hbase4:39673] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-03-07 10:53:37,366 DEBUG [RS:0;jenkins-hbase4:39673] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-07 10:53:37,366 DEBUG [RS:0;jenkins-hbase4:39673] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-07 10:53:37,367 DEBUG [RS:0;jenkins-hbase4:39673] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-07 10:53:37,367 DEBUG [RS:0;jenkins-hbase4:39673] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-07 10:53:37,367 DEBUG [RS:0;jenkins-hbase4:39673] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-07 10:53:37,367 DEBUG [RS:0;jenkins-hbase4:39673] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-03-07 10:53:37,367 DEBUG [RS:0;jenkins-hbase4:39673] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-07 10:53:37,367 DEBUG [RS:0;jenkins-hbase4:39673] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-07 10:53:37,367 DEBUG [RS:0;jenkins-hbase4:39673] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-07 10:53:37,367 DEBUG [RS:0;jenkins-hbase4:39673] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-07 10:53:37,368 INFO [RS:0;jenkins-hbase4:39673] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-03-07 10:53:37,369 INFO [RS:0;jenkins-hbase4:39673] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-03-07 10:53:37,369 INFO [RS:0;jenkins-hbase4:39673] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-03-07 10:53:37,385 INFO [RS:0;jenkins-hbase4:39673] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-03-07 10:53:37,389 INFO [RS:0;jenkins-hbase4:39673] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39673,1678186416064-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-03-07 10:53:37,406 INFO [RS:0;jenkins-hbase4:39673] regionserver.Replication(203): jenkins-hbase4.apache.org,39673,1678186416064 started 2023-03-07 10:53:37,406 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,39673,1678186416064, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39673, sessionid=0x100be9c69520001 2023-03-07 10:53:37,407 DEBUG [RS:0;jenkins-hbase4:39673] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-03-07 10:53:37,407 DEBUG [RS:0;jenkins-hbase4:39673] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:37,407 DEBUG [RS:0;jenkins-hbase4:39673] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39673,1678186416064' 2023-03-07 10:53:37,407 DEBUG [RS:0;jenkins-hbase4:39673] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:37,408 DEBUG [RS:0;jenkins-hbase4:39673] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:37,408 DEBUG [RS:0;jenkins-hbase4:39673] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-03-07 10:53:37,408 DEBUG [RS:0;jenkins-hbase4:39673] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-03-07 10:53:37,408 DEBUG [RS:0;jenkins-hbase4:39673] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:37,408 DEBUG [RS:0;jenkins-hbase4:39673] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39673,1678186416064' 2023-03-07 10:53:37,408 DEBUG [RS:0;jenkins-hbase4:39673] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-07 10:53:37,409 DEBUG [RS:0;jenkins-hbase4:39673] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-07 10:53:37,409 DEBUG [RS:0;jenkins-hbase4:39673] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-03-07 10:53:37,410 INFO [RS:0;jenkins-hbase4:39673] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-03-07 10:53:37,410 INFO [RS:0;jenkins-hbase4:39673] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-03-07 10:53:37,481 DEBUG [jenkins-hbase4:45579] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-03-07 10:53:37,483 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39673,1678186416064, state=OPENING 2023-03-07 10:53:37,492 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-03-07 10:53:37,493 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-07 10:53:37,494 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-03-07 10:53:37,498 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:53:37,520 INFO [RS:0;jenkins-hbase4:39673] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39673%2C1678186416064, suffix=, logDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/WALs/jenkins-hbase4.apache.org,39673,1678186416064, archiveDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/oldWALs, maxLogs=32 2023-03-07 10:53:37,553 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40929,DS-1a0e1cde-b8e7-4629-810f-4d688fc3b480,DISK] 2023-03-07 10:53:37,561 INFO [RS:0;jenkins-hbase4:39673] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/WALs/jenkins-hbase4.apache.org,39673,1678186416064/jenkins-hbase4.apache.org%2C39673%2C1678186416064.1678186417524 2023-03-07 10:53:37,564 DEBUG [RS:0;jenkins-hbase4:39673] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40929,DS-1a0e1cde-b8e7-4629-810f-4d688fc3b480,DISK]] 2023-03-07 10:53:37,688 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:37,691 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-07 10:53:37,696 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36482, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-07 10:53:37,709 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-03-07 10:53:37,710 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-07 10:53:37,718 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39673%2C1678186416064.meta, suffix=.meta, logDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/WALs/jenkins-hbase4.apache.org,39673,1678186416064, archiveDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/oldWALs, maxLogs=32 2023-03-07 10:53:37,744 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40929,DS-1a0e1cde-b8e7-4629-810f-4d688fc3b480,DISK] 2023-03-07 10:53:37,751 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/WALs/jenkins-hbase4.apache.org,39673,1678186416064/jenkins-hbase4.apache.org%2C39673%2C1678186416064.meta.1678186417721.meta 2023-03-07 10:53:37,756 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40929,DS-1a0e1cde-b8e7-4629-810f-4d688fc3b480,DISK]] 2023-03-07 10:53:37,756 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-03-07 10:53:37,760 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-03-07 10:53:37,782 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-03-07 10:53:37,787 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-03-07 10:53:37,794 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-03-07 10:53:37,794 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:53:37,794 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-03-07 10:53:37,794 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-03-07 10:53:37,797 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-03-07 10:53:37,800 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/1588230740/info 2023-03-07 10:53:37,800 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/1588230740/info 2023-03-07 10:53:37,800 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-03-07 10:53:37,801 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:53:37,802 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-03-07 10:53:37,806 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/1588230740/rep_barrier 2023-03-07 10:53:37,806 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/1588230740/rep_barrier 2023-03-07 10:53:37,807 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-03-07 10:53:37,808 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:53:37,808 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-03-07 10:53:37,809 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/1588230740/table 2023-03-07 10:53:37,810 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/1588230740/table 2023-03-07 10:53:37,810 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-03-07 10:53:37,811 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:53:37,813 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/1588230740 2023-03-07 10:53:37,816 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/1588230740 2023-03-07 10:53:37,820 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-03-07 10:53:37,822 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-03-07 10:53:37,824 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68128858, jitterRate=0.015199095010757446}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-03-07 10:53:37,824 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-03-07 10:53:37,835 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1678186417678 2023-03-07 10:53:37,864 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-03-07 10:53:37,865 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-03-07 10:53:37,865 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39673,1678186416064, state=OPEN 2023-03-07 10:53:37,868 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-03-07 10:53:37,868 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-03-07 10:53:37,877 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-03-07 10:53:37,878 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39673,1678186416064 in 370 msec 2023-03-07 10:53:37,884 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-03-07 10:53:37,884 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 567 msec 2023-03-07 10:53:37,890 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 819 msec 2023-03-07 10:53:37,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1678186417890, completionTime=-1 2023-03-07 10:53:37,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-03-07 10:53:37,891 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-03-07 10:53:37,965 DEBUG [hconnection-0xb0e6ef9-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-07 10:53:37,968 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36492, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-07 10:53:37,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=1 2023-03-07 10:53:37,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1678186477985 2023-03-07 10:53:37,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1678186537985 2023-03-07 10:53:37,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 94 msec 2023-03-07 10:53:38,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45579,1678186414835-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-03-07 10:53:38,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45579,1678186414835-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-03-07 10:53:38,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45579,1678186414835-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-03-07 10:53:38,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45579, period=300000, unit=MILLISECONDS is enabled. 2023-03-07 10:53:38,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-03-07 10:53:38,017 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-03-07 10:53:38,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-03-07 10:53:38,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-03-07 10:53:38,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-03-07 10:53:38,043 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-03-07 10:53:38,047 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-07 10:53:38,071 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/hbase/namespace/dd9504dc3e619e1f536d495d7e8cbf65 2023-03-07 10:53:38,074 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/hbase/namespace/dd9504dc3e619e1f536d495d7e8cbf65 empty. 2023-03-07 10:53:38,075 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/hbase/namespace/dd9504dc3e619e1f536d495d7e8cbf65 2023-03-07 10:53:38,075 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-03-07 10:53:38,096 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-03-07 10:53:38,098 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => dd9504dc3e619e1f536d495d7e8cbf65, NAME => 'hbase:namespace,,1678186418028.dd9504dc3e619e1f536d495d7e8cbf65.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp 2023-03-07 10:53:38,109 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1678186418028.dd9504dc3e619e1f536d495d7e8cbf65.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:53:38,109 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing dd9504dc3e619e1f536d495d7e8cbf65, disabling compactions & flushes 2023-03-07 10:53:38,109 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1678186418028.dd9504dc3e619e1f536d495d7e8cbf65. 2023-03-07 10:53:38,109 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1678186418028.dd9504dc3e619e1f536d495d7e8cbf65. 2023-03-07 10:53:38,109 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1678186418028.dd9504dc3e619e1f536d495d7e8cbf65. after waiting 0 ms 2023-03-07 10:53:38,109 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1678186418028.dd9504dc3e619e1f536d495d7e8cbf65. 2023-03-07 10:53:38,110 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1678186418028.dd9504dc3e619e1f536d495d7e8cbf65. 2023-03-07 10:53:38,110 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for dd9504dc3e619e1f536d495d7e8cbf65: 2023-03-07 10:53:38,114 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-03-07 10:53:38,129 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1678186418028.dd9504dc3e619e1f536d495d7e8cbf65.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1678186418117"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186418117"}]},"ts":"1678186418117"} 2023-03-07 10:53:38,156 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-07 10:53:38,158 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-07 10:53:38,164 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186418158"}]},"ts":"1678186418158"} 2023-03-07 10:53:38,168 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-03-07 10:53:38,178 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=dd9504dc3e619e1f536d495d7e8cbf65, ASSIGN}] 2023-03-07 10:53:38,181 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=dd9504dc3e619e1f536d495d7e8cbf65, ASSIGN 2023-03-07 10:53:38,184 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=dd9504dc3e619e1f536d495d7e8cbf65, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39673,1678186416064; forceNewPlan=false, retain=false 2023-03-07 10:53:38,335 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=dd9504dc3e619e1f536d495d7e8cbf65, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:38,336 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1678186418028.dd9504dc3e619e1f536d495d7e8cbf65.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1678186418335"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186418335"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186418335"}]},"ts":"1678186418335"} 2023-03-07 10:53:38,342 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure dd9504dc3e619e1f536d495d7e8cbf65, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:53:38,504 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1678186418028.dd9504dc3e619e1f536d495d7e8cbf65. 2023-03-07 10:53:38,506 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dd9504dc3e619e1f536d495d7e8cbf65, NAME => 'hbase:namespace,,1678186418028.dd9504dc3e619e1f536d495d7e8cbf65.', STARTKEY => '', ENDKEY => ''} 2023-03-07 10:53:38,507 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace dd9504dc3e619e1f536d495d7e8cbf65 2023-03-07 10:53:38,508 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1678186418028.dd9504dc3e619e1f536d495d7e8cbf65.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:53:38,508 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dd9504dc3e619e1f536d495d7e8cbf65 2023-03-07 10:53:38,508 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dd9504dc3e619e1f536d495d7e8cbf65 2023-03-07 10:53:38,511 INFO [StoreOpener-dd9504dc3e619e1f536d495d7e8cbf65-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region dd9504dc3e619e1f536d495d7e8cbf65 2023-03-07 10:53:38,513 DEBUG [StoreOpener-dd9504dc3e619e1f536d495d7e8cbf65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/namespace/dd9504dc3e619e1f536d495d7e8cbf65/info 2023-03-07 10:53:38,513 DEBUG [StoreOpener-dd9504dc3e619e1f536d495d7e8cbf65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/namespace/dd9504dc3e619e1f536d495d7e8cbf65/info 2023-03-07 10:53:38,514 INFO [StoreOpener-dd9504dc3e619e1f536d495d7e8cbf65-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd9504dc3e619e1f536d495d7e8cbf65 columnFamilyName info 2023-03-07 10:53:38,515 INFO [StoreOpener-dd9504dc3e619e1f536d495d7e8cbf65-1] regionserver.HStore(310): Store=dd9504dc3e619e1f536d495d7e8cbf65/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:53:38,516 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/namespace/dd9504dc3e619e1f536d495d7e8cbf65 2023-03-07 10:53:38,518 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/namespace/dd9504dc3e619e1f536d495d7e8cbf65 2023-03-07 10:53:38,523 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dd9504dc3e619e1f536d495d7e8cbf65 2023-03-07 10:53:38,527 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/namespace/dd9504dc3e619e1f536d495d7e8cbf65/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-07 10:53:38,528 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dd9504dc3e619e1f536d495d7e8cbf65; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62800294, jitterRate=-0.0642026960849762}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-07 10:53:38,529 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dd9504dc3e619e1f536d495d7e8cbf65: 2023-03-07 10:53:38,531 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1678186418028.dd9504dc3e619e1f536d495d7e8cbf65., pid=6, masterSystemTime=1678186418496 2023-03-07 10:53:38,536 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1678186418028.dd9504dc3e619e1f536d495d7e8cbf65. 2023-03-07 10:53:38,537 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1678186418028.dd9504dc3e619e1f536d495d7e8cbf65. 2023-03-07 10:53:38,538 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=dd9504dc3e619e1f536d495d7e8cbf65, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:38,539 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1678186418028.dd9504dc3e619e1f536d495d7e8cbf65.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1678186418537"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186418537"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186418537"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186418537"}]},"ts":"1678186418537"} 2023-03-07 10:53:38,547 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-03-07 10:53:38,547 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure dd9504dc3e619e1f536d495d7e8cbf65, server=jenkins-hbase4.apache.org,39673,1678186416064 in 201 msec 2023-03-07 10:53:38,550 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-03-07 10:53:38,551 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=dd9504dc3e619e1f536d495d7e8cbf65, ASSIGN in 369 msec 2023-03-07 10:53:38,552 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-07 10:53:38,552 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186418552"}]},"ts":"1678186418552"} 2023-03-07 10:53:38,555 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-03-07 10:53:38,558 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-03-07 10:53:38,561 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 528 msec 2023-03-07 10:53:38,643 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-03-07 10:53:38,646 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-03-07 10:53:38,646 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-07 10:53:38,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-03-07 10:53:38,698 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-07 10:53:38,704 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-03-07 10:53:38,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-03-07 10:53:38,727 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-07 10:53:38,733 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-03-07 10:53:38,742 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-03-07 10:53:38,746 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-03-07 10:53:38,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.609sec 2023-03-07 10:53:38,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-03-07 10:53:38,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-03-07 10:53:38,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-03-07 10:53:38,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45579,1678186414835-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-03-07 10:53:38,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45579,1678186414835-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-03-07 10:53:38,762 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-03-07 10:53:38,807 DEBUG [Listener at localhost/42383] zookeeper.ReadOnlyZKClient(139): Connect 0x0629018b to 127.0.0.1:56055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-07 10:53:38,812 DEBUG [Listener at localhost/42383] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c1e7f16, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-07 10:53:38,824 DEBUG [hconnection-0x77bc4ff1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-07 10:53:38,839 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36506, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-07 10:53:38,849 INFO [Listener at localhost/42383] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45579,1678186414835 2023-03-07 10:53:38,850 DEBUG [Listener at localhost/42383] zookeeper.ReadOnlyZKClient(139): Connect 0x7defec53 to 127.0.0.1:56055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-07 10:53:38,854 DEBUG [Listener at localhost/42383] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64b944ad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-07 10:53:38,855 INFO [Listener at localhost/42383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-07 10:53:38,876 INFO [Listener at localhost/42383] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=212, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=340, ProcessCount=171, AvailableMemoryMB=9816 2023-03-07 10:53:38,886 DEBUG [Listener at localhost/42383] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-07 10:53:38,889 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33938, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-07 10:53:38,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-07 10:53:38,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:38,905 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-03-07 10:53:38,907 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-07 10:53:38,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-03-07 10:53:38,910 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9 2023-03-07 10:53:38,912 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9 empty. 2023-03-07 10:53:38,914 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9 2023-03-07 10:53:38,914 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-03-07 10:53:38,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-07 10:53:38,934 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-03-07 10:53:38,936 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => d3470e709599a35cac3d1337722546a9, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp 2023-03-07 10:53:39,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-07 10:53:39,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-07 10:53:39,351 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:53:39,352 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing d3470e709599a35cac3d1337722546a9, disabling compactions & flushes 2023-03-07 10:53:39,352 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:39,352 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:39,352 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. after waiting 0 ms 2023-03-07 10:53:39,352 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:39,352 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:39,352 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for d3470e709599a35cac3d1337722546a9: 2023-03-07 10:53:39,358 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-03-07 10:53:39,359 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678186419359"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186419359"}]},"ts":"1678186419359"} 2023-03-07 10:53:39,362 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-07 10:53:39,363 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-07 10:53:39,364 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186419363"}]},"ts":"1678186419363"} 2023-03-07 10:53:39,366 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-03-07 10:53:39,372 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=d3470e709599a35cac3d1337722546a9, ASSIGN}] 2023-03-07 10:53:39,375 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=d3470e709599a35cac3d1337722546a9, ASSIGN 2023-03-07 10:53:39,377 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=d3470e709599a35cac3d1337722546a9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39673,1678186416064; forceNewPlan=false, retain=false 2023-03-07 10:53:39,528 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=d3470e709599a35cac3d1337722546a9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:39,528 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678186419528"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186419528"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186419528"}]},"ts":"1678186419528"} 2023-03-07 10:53:39,532 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure d3470e709599a35cac3d1337722546a9, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:53:39,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-07 10:53:39,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:39,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d3470e709599a35cac3d1337722546a9, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9.', STARTKEY => '', ENDKEY => ''} 2023-03-07 10:53:39,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly d3470e709599a35cac3d1337722546a9 2023-03-07 10:53:39,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:53:39,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d3470e709599a35cac3d1337722546a9 2023-03-07 10:53:39,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d3470e709599a35cac3d1337722546a9 2023-03-07 10:53:39,695 INFO [StoreOpener-d3470e709599a35cac3d1337722546a9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d3470e709599a35cac3d1337722546a9 2023-03-07 10:53:39,697 DEBUG [StoreOpener-d3470e709599a35cac3d1337722546a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1 2023-03-07 10:53:39,697 DEBUG [StoreOpener-d3470e709599a35cac3d1337722546a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1 2023-03-07 10:53:39,700 INFO [StoreOpener-d3470e709599a35cac3d1337722546a9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d3470e709599a35cac3d1337722546a9 columnFamilyName family1 2023-03-07 10:53:39,703 INFO [StoreOpener-d3470e709599a35cac3d1337722546a9-1] regionserver.HStore(310): Store=d3470e709599a35cac3d1337722546a9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:53:39,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9 2023-03-07 10:53:39,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9 2023-03-07 10:53:39,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d3470e709599a35cac3d1337722546a9 2023-03-07 10:53:39,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-07 10:53:39,715 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d3470e709599a35cac3d1337722546a9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59822732, jitterRate=-0.10857182741165161}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-07 10:53:39,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d3470e709599a35cac3d1337722546a9: 2023-03-07 10:53:39,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9., pid=11, masterSystemTime=1678186419685 2023-03-07 10:53:39,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:39,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:39,721 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=d3470e709599a35cac3d1337722546a9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:39,721 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678186419721"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186419721"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186419721"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186419721"}]},"ts":"1678186419721"} 2023-03-07 10:53:39,729 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-03-07 10:53:39,730 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure d3470e709599a35cac3d1337722546a9, server=jenkins-hbase4.apache.org,39673,1678186416064 in 195 msec 2023-03-07 10:53:39,733 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-03-07 10:53:39,733 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=d3470e709599a35cac3d1337722546a9, ASSIGN in 357 msec 2023-03-07 10:53:39,735 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-07 10:53:39,735 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186419735"}]},"ts":"1678186419735"} 2023-03-07 10:53:39,737 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-03-07 10:53:39,742 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-03-07 10:53:39,745 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 841 msec 2023-03-07 10:53:40,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-07 10:53:40,042 INFO [Listener at localhost/42383] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-03-07 10:53:40,059 DEBUG [hconnection-0x3666aa34-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-07 10:53:40,062 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36518, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-07 10:53:40,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:53:40,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:40,221 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-07 10:53:40,221 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:40,222 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-07 10:53:40,222 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-07 10:53:40,222 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:40,222 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:40,224 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:40,225 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:40,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:40,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:40,225 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:40,225 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:53:40,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:40,226 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:40,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:53:40,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:40,226 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:40,228 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:40,228 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-07 10:53:40,228 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:40,229 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-07 10:53:40,230 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:53:40,230 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:53:40,230 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:40,230 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. started... 2023-03-07 10:53:40,231 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d3470e709599a35cac3d1337722546a9 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-07 10:53:40,769 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130a63fb4cb74134ce8a48dfc2d74c6c6e1 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130a63fb4cb74134ce8a48dfc2d74c6c6e1 2023-03-07 10:53:41,187 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/.tmp/family1/2d050c566c214320a2fa891001b07e04 2023-03-07 10:53:41,197 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/.tmp/family1/2d050c566c214320a2fa891001b07e04 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/2d050c566c214320a2fa891001b07e04 2023-03-07 10:53:41,207 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/2d050c566c214320a2fa891001b07e04, entries=1000, sequenceid=5, filesize=175.8 K 2023-03-07 10:53:41,210 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for d3470e709599a35cac3d1337722546a9 in 979ms, sequenceid=5, compaction requested=false 2023-03-07 10:53:41,212 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-07 10:53:41,215 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d3470e709599a35cac3d1337722546a9: 2023-03-07 10:53:41,215 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:41,215 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:53:41,216 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:53:41,216 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,216 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-07 10:53:41,216 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-07 10:53:41,219 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,219 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:41,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:41,220 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,220 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:53:41,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:41,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:41,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:41,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-07 10:53:41,222 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-07 10:53:41,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c39f557[Count = 0] remaining members to acquire global barrier 2023-03-07 10:53:41,223 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,224 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,225 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-07 10:53:41,225 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,225 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-07 10:53:41,225 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:53:41,225 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:53:41,228 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-07 10:53:41,228 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,228 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:41,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:41,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:41,228 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-07 10:53:41,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:41,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:41,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:41,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:53:41,233 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-07 10:53:41,233 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:53:41,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-07 10:53:41,233 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:53:41,233 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,233 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:53:41,237 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,237 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,237 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:41,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:41,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:41,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:41,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:41,238 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:41,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:41,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,242 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:41,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,251 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,252 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,252 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,252 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,252 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,252 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:41,252 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:41,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:41,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:41,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:41,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:41,257 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,257 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,257 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:41,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-07 10:53:41,257 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-07 10:53:41,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:53:41,259 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-07 10:53:41,260 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:53:41,360 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:53:41,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:53:41,378 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:53:41,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-07 10:53:41,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,382 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-07 10:53:41,382 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:41,382 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-07 10:53:41,382 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-07 10:53:41,383 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,383 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,385 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:41,385 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:41,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:41,386 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,386 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:53:41,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,386 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:53:41,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,387 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,387 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-07 10:53:41,387 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,387 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-07 10:53:41,387 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:41,388 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-07 10:53:41,388 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:53:41,388 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:53:41,388 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:41,388 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. started... 2023-03-07 10:53:41,388 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d3470e709599a35cac3d1337722546a9 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-07 10:53:41,417 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511285bf09cc2051e4db3918201882eafeb58 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511285bf09cc2051e4db3918201882eafeb58 2023-03-07 10:53:41,827 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/.tmp/family1/128c8660a1764f93a3ecb2bf0799088a 2023-03-07 10:53:41,838 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/.tmp/family1/128c8660a1764f93a3ecb2bf0799088a as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/128c8660a1764f93a3ecb2bf0799088a 2023-03-07 10:53:41,847 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/128c8660a1764f93a3ecb2bf0799088a, entries=1, sequenceid=9, filesize=5.0 K 2023-03-07 10:53:41,848 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for d3470e709599a35cac3d1337722546a9 in 460ms, sequenceid=9, compaction requested=false 2023-03-07 10:53:41,849 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d3470e709599a35cac3d1337722546a9: 2023-03-07 10:53:41,849 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:41,849 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:53:41,849 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:53:41,849 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,850 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-07 10:53:41,850 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-07 10:53:41,852 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,852 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:41,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:41,852 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,852 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:53:41,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:41,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:41,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:41,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-07 10:53:41,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21ed1b4c[Count = 0] remaining members to acquire global barrier 2023-03-07 10:53:41,854 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-07 10:53:41,854 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,856 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,857 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-07 10:53:41,857 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-07 10:53:41,857 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:53:41,857 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,857 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:53:41,859 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,859 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-07 10:53:41,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:41,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:41,859 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:41,859 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-07 10:53:41,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:41,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:41,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:41,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:53:41,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-07 10:53:41,862 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-07 10:53:41,862 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:53:41,862 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:53:41,862 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,862 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:53:41,867 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,867 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:41,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:41,867 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:41,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:41,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:41,868 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:41,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:41,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,869 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:41,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,874 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,874 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,874 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:41,874 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,874 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:41,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:41,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:41,874 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:41,874 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-07 10:53:41,874 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-07 10:53:41,874 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:53:41,875 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,875 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:41,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:41,875 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-07 10:53:41,875 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:53:41,975 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:53:41,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:53:41,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:53:41,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-07 10:53:41,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,987 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-07 10:53:41,988 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:41,988 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-07 10:53:41,988 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-07 10:53:41,989 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,989 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,990 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,990 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:41,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:41,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:41,991 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:41,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,991 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:53:41,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:53:41,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,992 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,992 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-07 10:53:41,992 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:41,992 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-07 10:53:41,992 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:41,993 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-07 10:53:41,993 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:53:41,993 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:53:41,993 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:41,993 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. started... 2023-03-07 10:53:41,993 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d3470e709599a35cac3d1337722546a9 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:53:42,418 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201fb7765f3bcbb45d682882ff6586fe299 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201fb7765f3bcbb45d682882ff6586fe299 2023-03-07 10:53:42,830 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/.tmp/family1/1f78aa27ec404beb89667c1f458a9b95 2023-03-07 10:53:42,840 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/.tmp/family1/1f78aa27ec404beb89667c1f458a9b95 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/1f78aa27ec404beb89667c1f458a9b95 2023-03-07 10:53:42,848 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/1f78aa27ec404beb89667c1f458a9b95, entries=1, sequenceid=13, filesize=5.0 K 2023-03-07 10:53:42,849 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d3470e709599a35cac3d1337722546a9 in 856ms, sequenceid=13, compaction requested=true 2023-03-07 10:53:42,849 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d3470e709599a35cac3d1337722546a9: 2023-03-07 10:53:42,849 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:42,849 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:53:42,850 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:53:42,850 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:42,850 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-07 10:53:42,850 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-07 10:53:42,852 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:42,852 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:42,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:42,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:42,853 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,853 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:53:42,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:42,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:42,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:42,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:42,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-07 10:53:42,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@623197f4[Count = 0] remaining members to acquire global barrier 2023-03-07 10:53:42,855 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-07 10:53:42,855 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,856 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,856 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-07 10:53:42,856 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-07 10:53:42,856 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:53:42,856 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:42,856 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:53:42,858 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-07 10:53:42,858 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:42,858 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:42,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:42,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:42,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:42,858 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-07 10:53:42,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:42,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:42,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:42,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:42,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:42,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:53:42,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-07 10:53:42,861 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-07 10:53:42,861 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:53:42,862 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:53:42,862 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,862 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:53:42,864 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,864 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:42,864 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:42,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:42,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:42,865 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:42,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:42,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,867 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:42,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:42,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:42,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:42,871 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:42,871 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,871 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,871 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:42,871 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,871 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:42,871 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,871 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,871 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:42,871 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-07 10:53:42,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:42,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:42,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-07 10:53:42,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:53:42,871 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:42,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:42,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:42,872 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-07 10:53:42,872 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:53:42,973 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:53:42,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:53:42,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:53:42,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-07 10:53:42,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,985 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-07 10:53:42,985 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:42,986 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-07 10:53:42,986 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-07 10:53:42,986 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,986 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,987 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:42,988 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:42,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:42,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:42,988 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:42,988 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:53:42,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:53:42,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,989 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,989 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-07 10:53:42,989 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:42,989 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-07 10:53:42,989 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:42,990 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-07 10:53:42,990 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:53:42,990 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:53:42,990 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:42,990 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. started... 2023-03-07 10:53:42,990 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d3470e709599a35cac3d1337722546a9 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:53:43,313 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-07 10:53:43,364 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-03-07 10:53:43,365 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-03-07 10:53:43,417 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205034997e5c8f44fb58adfc46fb0039fa2 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205034997e5c8f44fb58adfc46fb0039fa2 2023-03-07 10:53:43,829 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/.tmp/family1/e5f33e28b47343259bd460944a550f1e 2023-03-07 10:53:43,838 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/.tmp/family1/e5f33e28b47343259bd460944a550f1e as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/e5f33e28b47343259bd460944a550f1e 2023-03-07 10:53:43,846 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/e5f33e28b47343259bd460944a550f1e, entries=1, sequenceid=17, filesize=5.0 K 2023-03-07 10:53:43,847 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d3470e709599a35cac3d1337722546a9 in 857ms, sequenceid=17, compaction requested=true 2023-03-07 10:53:43,848 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d3470e709599a35cac3d1337722546a9: 2023-03-07 10:53:43,848 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:43,848 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:53:43,849 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:53:43,849 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:43,849 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-07 10:53:43,849 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-07 10:53:43,851 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,851 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:43,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:43,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:43,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:43,852 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,852 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:53:43,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:43,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:43,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:43,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:43,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-07 10:53:43,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3573b18[Count = 0] remaining members to acquire global barrier 2023-03-07 10:53:43,854 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-07 10:53:43,854 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,856 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,856 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-07 10:53:43,856 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-07 10:53:43,856 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:53:43,856 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:43,856 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:53:43,858 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:43,858 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-07 10:53:43,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:43,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:43,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:43,858 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:43,858 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-07 10:53:43,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:43,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:43,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:43,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:43,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:43,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:53:43,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-07 10:53:43,863 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-07 10:53:43,863 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:53:43,863 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:53:43,863 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,863 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:53:43,866 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,866 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:43,866 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:43,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:43,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:43,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:43,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:43,867 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:43,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:43,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,868 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:43,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:43,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:43,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:43,873 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:43,873 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:43,873 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:43,873 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:43,873 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:43,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:43,873 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-07 10:53:43,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-07 10:53:43,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:53:43,874 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:43,874 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,874 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,874 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:43,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:43,874 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-07 10:53:43,875 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:53:43,975 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:53:43,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:53:43,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:53:43,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-07 10:53:43,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,988 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-07 10:53:43,988 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:43,988 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-07 10:53:43,988 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-07 10:53:43,989 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,989 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,991 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:43,991 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:43,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:43,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:43,992 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:43,992 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:53:43,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,993 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:53:43,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,993 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,994 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-07 10:53:43,994 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:43,994 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-07 10:53:43,994 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:43,994 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-07 10:53:43,994 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:53:43,994 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:53:43,995 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:43,995 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. started... 2023-03-07 10:53:43,995 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d3470e709599a35cac3d1337722546a9 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:53:44,426 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512281f7859de33bb4617b6eb4507de4b917a to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512281f7859de33bb4617b6eb4507de4b917a 2023-03-07 10:53:44,840 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/.tmp/family1/d94e53ed86c147d4af498b8ccce2d814 2023-03-07 10:53:44,850 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/.tmp/family1/d94e53ed86c147d4af498b8ccce2d814 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/d94e53ed86c147d4af498b8ccce2d814 2023-03-07 10:53:44,858 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/d94e53ed86c147d4af498b8ccce2d814, entries=1, sequenceid=21, filesize=5.0 K 2023-03-07 10:53:44,859 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d3470e709599a35cac3d1337722546a9 in 864ms, sequenceid=21, compaction requested=true 2023-03-07 10:53:44,859 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d3470e709599a35cac3d1337722546a9: 2023-03-07 10:53:44,859 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:44,859 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:53:44,860 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:53:44,860 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:44,860 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-07 10:53:44,860 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-07 10:53:44,865 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:44,865 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:44,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:44,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:44,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:44,865 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:44,865 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:53:44,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:44,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:44,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:44,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:44,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:44,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-07 10:53:44,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1057e568[Count = 0] remaining members to acquire global barrier 2023-03-07 10:53:44,867 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-07 10:53:44,867 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:44,874 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:44,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:44,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:44,875 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-07 10:53:44,875 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-07 10:53:44,875 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:53:44,875 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:44,875 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:53:44,876 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-07 10:53:44,876 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:44,876 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:44,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:44,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:44,877 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-07 10:53:44,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:44,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:44,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:44,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:44,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:44,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:44,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:44,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:44,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:53:44,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-07 10:53:44,880 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-07 10:53:44,880 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:53:44,880 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:53:44,880 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:44,880 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:53:44,882 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:44,882 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:44,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:44,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:44,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:44,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:44,882 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:44,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:44,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:44,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:44,883 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:44,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:44,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:44,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:44,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:44,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:44,884 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:44,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:44,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:44,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:44,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:44,887 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:44,887 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:44,887 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:44,887 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:44,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:44,887 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:44,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:44,887 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-07 10:53:44,887 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:53:44,887 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-07 10:53:44,887 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:44,887 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:44,888 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:44,888 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:44,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:44,888 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:44,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:44,888 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-07 10:53:44,888 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:53:44,989 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:53:44,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:53:44,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:53:45,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-07 10:53:45,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,000 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-07 10:53:45,000 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:45,001 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-07 10:53:45,001 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-07 10:53:45,001 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,002 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,004 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:45,004 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:45,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:45,005 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,005 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:53:45,005 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:53:45,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,005 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,006 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-07 10:53:45,006 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,006 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-07 10:53:45,006 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:45,006 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-07 10:53:45,007 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:53:45,007 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:53:45,007 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:45,007 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. started... 2023-03-07 10:53:45,007 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d3470e709599a35cac3d1337722546a9 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:53:45,017 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-03-07 10:53:45,018 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-03-07 10:53:45,067 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512310b80d7a9b731474c8d5760102639bd6a to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512310b80d7a9b731474c8d5760102639bd6a 2023-03-07 10:53:45,078 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/.tmp/family1/b37fffae6f454d15909282e7d45d90ec 2023-03-07 10:53:45,086 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/.tmp/family1/b37fffae6f454d15909282e7d45d90ec as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/b37fffae6f454d15909282e7d45d90ec 2023-03-07 10:53:45,093 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/b37fffae6f454d15909282e7d45d90ec, entries=1, sequenceid=25, filesize=5.0 K 2023-03-07 10:53:45,094 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d3470e709599a35cac3d1337722546a9 in 87ms, sequenceid=25, compaction requested=true 2023-03-07 10:53:45,094 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d3470e709599a35cac3d1337722546a9: 2023-03-07 10:53:45,094 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:45,095 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:53:45,095 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:53:45,095 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,095 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-07 10:53:45,095 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-07 10:53:45,097 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,097 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:45,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:45,097 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,097 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:53:45,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:45,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:45,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:45,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-07 10:53:45,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5929bb55[Count = 0] remaining members to acquire global barrier 2023-03-07 10:53:45,099 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-07 10:53:45,099 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,101 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,101 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-07 10:53:45,101 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-07 10:53:45,101 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:53:45,101 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,101 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:53:45,104 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-07 10:53:45,104 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,104 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:45,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:45,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:45,104 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-07 10:53:45,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:45,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:45,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:45,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:53:45,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-07 10:53:45,108 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-07 10:53:45,108 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:53:45,108 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:53:45,108 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,108 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:53:45,110 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,110 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:45,110 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:45,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:45,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:45,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:45,111 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:45,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:45,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,113 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:45,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,116 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,116 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:45,116 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:45,116 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:45,116 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:45,116 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:45,116 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-07 10:53:45,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-07 10:53:45,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:53:45,117 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,117 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:45,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:45,117 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,117 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-07 10:53:45,118 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:53:45,218 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:53:45,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:53:45,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:53:45,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-07 10:53:45,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,229 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-07 10:53:45,229 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:45,229 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-07 10:53:45,229 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-07 10:53:45,230 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,230 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,231 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:45,231 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:45,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:45,232 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,232 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:53:45,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:53:45,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,233 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,233 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-07 10:53:45,233 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,234 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-07 10:53:45,234 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:45,234 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-07 10:53:45,234 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:53:45,234 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:53:45,234 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:45,234 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. started... 2023-03-07 10:53:45,235 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d3470e709599a35cac3d1337722546a9 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:53:45,659 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101d36614f070084d41aaa3ebe4e753f1b4 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101d36614f070084d41aaa3ebe4e753f1b4 2023-03-07 10:53:45,668 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/.tmp/family1/26d348106bb5467691376f9ca81cdc5c 2023-03-07 10:53:45,675 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/.tmp/family1/26d348106bb5467691376f9ca81cdc5c as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/26d348106bb5467691376f9ca81cdc5c 2023-03-07 10:53:45,683 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/26d348106bb5467691376f9ca81cdc5c, entries=1, sequenceid=29, filesize=5.0 K 2023-03-07 10:53:45,684 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d3470e709599a35cac3d1337722546a9 in 449ms, sequenceid=29, compaction requested=true 2023-03-07 10:53:45,684 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d3470e709599a35cac3d1337722546a9: 2023-03-07 10:53:45,685 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:45,685 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:53:45,685 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:53:45,685 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,685 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-07 10:53:45,685 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-07 10:53:45,687 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,687 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:45,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:45,687 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,687 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:53:45,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:45,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:45,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:45,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-07 10:53:45,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@374919b3[Count = 0] remaining members to acquire global barrier 2023-03-07 10:53:45,689 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-07 10:53:45,689 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,690 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,691 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-07 10:53:45,691 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-07 10:53:45,691 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:53:45,691 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,691 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:53:45,693 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-07 10:53:45,693 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,693 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:45,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,693 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-07 10:53:45,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:45,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:45,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:45,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:45,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:45,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:53:45,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-07 10:53:45,699 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-07 10:53:45,699 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:53:45,699 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:53:45,699 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,699 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:53:45,702 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,702 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:45,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,702 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:45,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:45,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:45,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:45,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:45,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,703 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:45,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,705 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:45,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,713 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,713 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-07 10:53:45,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:53:45,713 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:45,713 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,714 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,714 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,714 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,714 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,713 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:45,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:45,714 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:45,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:45,714 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-07 10:53:45,715 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:53:45,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:45,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:45,815 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:53:45,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:53:45,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:53:45,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-07 10:53:45,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,826 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-07 10:53:45,826 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:45,827 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-07 10:53:45,827 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-07 10:53:45,827 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,827 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,829 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,829 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:45,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:45,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:45,829 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:45,829 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:53:45,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,830 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:53:45,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,830 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,830 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-07 10:53:45,831 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:45,831 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-07 10:53:45,831 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:45,831 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-07 10:53:45,831 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:53:45,831 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:53:45,831 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:45,831 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. started... 2023-03-07 10:53:45,832 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d3470e709599a35cac3d1337722546a9 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:53:46,252 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010389fa8268c1e4406291e5ccb17cea5b16 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010389fa8268c1e4406291e5ccb17cea5b16 2023-03-07 10:53:46,662 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/.tmp/family1/f062fb65073349818fda9f09c53cdbec 2023-03-07 10:53:46,670 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/.tmp/family1/f062fb65073349818fda9f09c53cdbec as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/f062fb65073349818fda9f09c53cdbec 2023-03-07 10:53:46,677 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/f062fb65073349818fda9f09c53cdbec, entries=1, sequenceid=33, filesize=5.0 K 2023-03-07 10:53:46,679 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d3470e709599a35cac3d1337722546a9 in 846ms, sequenceid=33, compaction requested=true 2023-03-07 10:53:46,679 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d3470e709599a35cac3d1337722546a9: 2023-03-07 10:53:46,679 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:46,679 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:53:46,679 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:53:46,679 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:46,680 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-07 10:53:46,680 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-07 10:53:46,681 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:46,681 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:46,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:46,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:46,682 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:46,682 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:53:46,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:46,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:46,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:46,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-07 10:53:46,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d7c6bb9[Count = 0] remaining members to acquire global barrier 2023-03-07 10:53:46,683 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-07 10:53:46,683 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,684 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,684 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-07 10:53:46,684 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-07 10:53:46,685 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:53:46,685 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:46,685 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:53:46,687 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:46,687 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-07 10:53:46,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:46,687 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:46,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:46,687 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-07 10:53:46,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:46,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:46,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:46,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:46,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:46,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:46,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:53:46,691 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-07 10:53:46,691 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-07 10:53:46,691 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:53:46,691 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:53:46,691 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,691 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:53:46,693 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,693 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:46,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:46,693 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:46,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:46,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:46,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:46,693 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:46,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:46,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:46,695 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:46,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:46,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:46,697 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:46,697 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:46,697 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-07 10:53:46,698 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,698 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:46,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:46,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:46,698 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:46,698 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:46,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:53:46,698 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,698 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,699 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:46,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:46,699 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-07 10:53:46,699 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:53:46,799 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:53:46,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:53:46,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:53:46,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-07 10:53:46,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,811 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-07 10:53:46,811 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:46,811 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-07 10:53:46,812 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-07 10:53:46,812 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,812 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,814 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:46,814 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:46,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:46,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:46,814 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:46,814 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:53:46,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,815 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:53:46,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,815 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,815 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-07 10:53:46,815 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:46,816 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-07 10:53:46,816 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:46,817 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-07 10:53:46,817 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:53:46,817 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:53:46,817 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:46,817 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. started... 2023-03-07 10:53:46,817 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d3470e709599a35cac3d1337722546a9 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:53:47,242 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907c57860d14130454ebe902c8d5a5e98a1 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907c57860d14130454ebe902c8d5a5e98a1 2023-03-07 10:53:47,255 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/.tmp/family1/93fc037f3bdc4b18b5235a9f00fc4843 2023-03-07 10:53:47,264 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/.tmp/family1/93fc037f3bdc4b18b5235a9f00fc4843 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/93fc037f3bdc4b18b5235a9f00fc4843 2023-03-07 10:53:47,273 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/93fc037f3bdc4b18b5235a9f00fc4843, entries=1, sequenceid=37, filesize=5.0 K 2023-03-07 10:53:47,275 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d3470e709599a35cac3d1337722546a9 in 458ms, sequenceid=37, compaction requested=true 2023-03-07 10:53:47,275 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d3470e709599a35cac3d1337722546a9: 2023-03-07 10:53:47,275 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:47,275 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:53:47,276 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:53:47,276 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,276 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-07 10:53:47,276 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-07 10:53:47,278 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,278 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:47,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:47,278 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,278 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:53:47,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:47,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:47,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:47,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-07 10:53:47,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@222fa3db[Count = 0] remaining members to acquire global barrier 2023-03-07 10:53:47,281 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-07 10:53:47,281 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,282 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,283 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-07 10:53:47,283 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-07 10:53:47,283 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:53:47,283 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,283 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:53:47,286 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-07 10:53:47,286 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:47,286 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-07 10:53:47,286 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:47,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:47,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:47,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:47,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:47,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:53:47,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-07 10:53:47,291 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-07 10:53:47,291 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:53:47,291 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:53:47,291 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,291 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:53:47,293 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,293 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:47,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,293 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:47,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:47,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:47,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:47,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:47,296 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:47,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,297 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:47,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,305 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,305 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,305 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:47,305 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:47,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:47,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:47,306 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,306 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,306 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,306 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:47,306 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-07 10:53:47,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-07 10:53:47,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:53:47,306 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,307 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,307 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-07 10:53:47,307 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:53:47,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:47,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:47,407 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:53:47,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:53:47,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:53:47,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-07 10:53:47,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,420 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-07 10:53:47,420 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:47,421 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-07 10:53:47,421 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-07 10:53:47,421 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,421 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,423 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,423 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:47,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:47,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:47,423 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,423 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:53:47,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,424 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:53:47,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,424 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,425 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-07 10:53:47,425 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,425 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-07 10:53:47,425 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:47,426 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-07 10:53:47,426 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:53:47,426 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:53:47,427 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:47,427 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. started... 2023-03-07 10:53:47,427 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d3470e709599a35cac3d1337722546a9 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:53:47,851 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120aed7284f6c19499e84fbdaa6b0c4895e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120aed7284f6c19499e84fbdaa6b0c4895e 2023-03-07 10:53:47,889 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/.tmp/family1/0ad7c97a8853413fbe077e1a1b766357 2023-03-07 10:53:47,897 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/.tmp/family1/0ad7c97a8853413fbe077e1a1b766357 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/0ad7c97a8853413fbe077e1a1b766357 2023-03-07 10:53:47,904 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/0ad7c97a8853413fbe077e1a1b766357, entries=1, sequenceid=41, filesize=5.0 K 2023-03-07 10:53:47,906 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d3470e709599a35cac3d1337722546a9 in 479ms, sequenceid=41, compaction requested=true 2023-03-07 10:53:47,906 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d3470e709599a35cac3d1337722546a9: 2023-03-07 10:53:47,906 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:47,906 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:53:47,907 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:53:47,907 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,907 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-07 10:53:47,907 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-07 10:53:47,909 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,909 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:47,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:47,910 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,910 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:53:47,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:47,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:47,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:47,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-07 10:53:47,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@364857d8[Count = 0] remaining members to acquire global barrier 2023-03-07 10:53:47,913 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-07 10:53:47,913 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,914 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,914 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,914 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:53:47,914 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-07 10:53:47,914 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-07 10:53:47,914 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:53:47,925 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-07 10:53:47,925 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:47,925 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-07 10:53:47,925 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:47,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:47,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:47,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:47,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:47,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:53:47,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-07 10:53:47,931 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-07 10:53:47,931 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:53:47,931 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:53:47,931 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,931 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:53:47,933 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,933 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,933 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:47,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:47,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:47,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:47,934 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:47,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:47,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:47,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,935 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:47,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,939 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:47,939 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,939 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,939 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,939 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:47,939 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,939 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,939 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:47,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:47,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:47,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-07 10:53:47,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:53:47,939 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:47,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-07 10:53:47,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:47,939 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:47,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:47,940 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-07 10:53:47,940 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:53:48,040 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:53:48,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:53:48,048 DEBUG [Listener at localhost/42383] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-07 10:53:48,051 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44054, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-07 10:53:48,055 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45579] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:48,068 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-07 10:53:48,069 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-07 10:53:48,071 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678187028071 2023-03-07 10:53:48,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:53:48,073 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-07 10:53:48,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-03-07 10:53:48,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-07 10:53:48,078 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] zookeeper.ReadOnlyZKClient(139): Connect 0x70134324 to 127.0.0.1:56055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-07 10:53:48,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1cf13224, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-07 10:53:48,092 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-07 10:53:49,047 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103327b3e4a8fbe4d509bb8979839470b3e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103327b3e4a8fbe4d509bb8979839470b3e 2023-03-07 10:53:49,048 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-07 10:53:49,069 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-07 10:53:49,071 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52128, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-07 10:53:49,083 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-07 10:53:49,084 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44068, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-07 10:53:49,119 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a5ddfcf648e4400eb9a3c718c91e496b first=Optional[r3] last=Optional[r6] 2023-03-07 10:53:49,134 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a5ddfcf648e4400eb9a3c718c91e496b}] 2023-03-07 10:53:49,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a5ddfcf648e4400eb9a3c718c91e496b for inclusion in d3470e709599a35cac3d1337722546a9/family1 2023-03-07 10:53:49,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-07 10:53:49,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(777): Region bounds: first= last= 2023-03-07 10:53:49,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for d3470e709599a35cac3d1337722546a9: 2023-03-07 10:53:49,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a5ddfcf648e4400eb9a3c718c91e496b to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ml0ij88rl70l0ja7s674tip22foaai4be5ldjtqf065e0adl4pe4tqrufg817na3/family1/a5ddfcf648e4400eb9a3c718c91e496b 2023-03-07 10:53:49,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ml0ij88rl70l0ja7s674tip22foaai4be5ldjtqf065e0adl4pe4tqrufg817na3/family1/a5ddfcf648e4400eb9a3c718c91e496b as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/04662500326b4a609ce4fb05638a266a_SeqId_44_ 2023-03-07 10:53:49,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ml0ij88rl70l0ja7s674tip22foaai4be5ldjtqf065e0adl4pe4tqrufg817na3/family1/a5ddfcf648e4400eb9a3c718c91e496b into d3470e709599a35cac3d1337722546a9/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/04662500326b4a609ce4fb05638a266a_SeqId_44_ - updating store file list. 2023-03-07 10:53:49,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/04662500326b4a609ce4fb05638a266a_SeqId_44_ into d3470e709599a35cac3d1337722546a9/family1 2023-03-07 10:53:49,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ml0ij88rl70l0ja7s674tip22foaai4be5ldjtqf065e0adl4pe4tqrufg817na3/family1/a5ddfcf648e4400eb9a3c718c91e496b into d3470e709599a35cac3d1337722546a9/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/04662500326b4a609ce4fb05638a266a_SeqId_44_) 2023-03-07 10:53:49,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ml0ij88rl70l0ja7s674tip22foaai4be5ldjtqf065e0adl4pe4tqrufg817na3/family1/a5ddfcf648e4400eb9a3c718c91e496b 2023-03-07 10:53:49,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-07 10:53:49,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-07 10:53:49,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(1912): d3470e709599a35cac3d1337722546a9/family1 is initiating minor compaction 2023-03-07 10:53:49,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@10d5e014; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:53:49,198 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d3470e709599a35cac3d1337722546a9/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:49,199 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/128c8660a1764f93a3ecb2bf0799088a, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/1f78aa27ec404beb89667c1f458a9b95, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/e5f33e28b47343259bd460944a550f1e, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/d94e53ed86c147d4af498b8ccce2d814, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/b37fffae6f454d15909282e7d45d90ec, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/26d348106bb5467691376f9ca81cdc5c, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/f062fb65073349818fda9f09c53cdbec, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/93fc037f3bdc4b18b5235a9f00fc4843, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/0ad7c97a8853413fbe077e1a1b766357, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/04662500326b4a609ce4fb05638a266a_SeqId_44_] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/.tmp, totalSize=50.2 K 2023-03-07 10:53:49,200 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 128c8660a1764f93a3ecb2bf0799088a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-07 10:53:49,200 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 1f78aa27ec404beb89667c1f458a9b95, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-07 10:53:49,200 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting e5f33e28b47343259bd460944a550f1e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-07 10:53:49,200 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting d94e53ed86c147d4af498b8ccce2d814, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-07 10:53:49,200 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting b37fffae6f454d15909282e7d45d90ec, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-07 10:53:49,200 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 26d348106bb5467691376f9ca81cdc5c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-07 10:53:49,201 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting f062fb65073349818fda9f09c53cdbec, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-07 10:53:49,201 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 93fc037f3bdc4b18b5235a9f00fc4843, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-07 10:53:49,201 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 0ad7c97a8853413fbe077e1a1b766357, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-07 10:53:49,201 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 04662500326b4a609ce4fb05638a266a_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-07 10:53:49,213 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-07 10:53:49,215 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:53:49,221 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512281f7859de33bb4617b6eb4507de4b917a to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512281f7859de33bb4617b6eb4507de4b917a 2023-03-07 10:53:49,222 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512310b80d7a9b731474c8d5760102639bd6a to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512310b80d7a9b731474c8d5760102639bd6a 2023-03-07 10:53:49,224 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101d36614f070084d41aaa3ebe4e753f1b4 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101d36614f070084d41aaa3ebe4e753f1b4 2023-03-07 10:53:49,226 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010389fa8268c1e4406291e5ccb17cea5b16 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010389fa8268c1e4406291e5ccb17cea5b16 2023-03-07 10:53:49,226 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-03-07 10:53:49,226 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-07 10:53:49,227 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-07 10:53:49,227 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-07 10:53:49,227 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-07 10:53:49,227 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-07 10:53:49,227 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-07 10:53:49,227 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-07 10:53:49,227 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-07 10:53:49,227 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-07 10:53:49,257 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] throttle.PressureAwareThroughputController(145): d3470e709599a35cac3d1337722546a9#family1#compaction#10 average throughput is 0.48 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:53:49,288 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/.tmp/family1/b128eec54ac647889a50cfc9606598d9 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/b128eec54ac647889a50cfc9606598d9 2023-03-07 10:53:49,317 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in d3470e709599a35cac3d1337722546a9/family1 of d3470e709599a35cac3d1337722546a9 into b128eec54ac647889a50cfc9606598d9(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-07 10:53:49,318 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d3470e709599a35cac3d1337722546a9: 2023-03-07 10:53:49,319 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1678186429196; duration=0sec 2023-03-07 10:53:49,320 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:53:49,380 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/128c8660a1764f93a3ecb2bf0799088a, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/1f78aa27ec404beb89667c1f458a9b95, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/e5f33e28b47343259bd460944a550f1e, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/d94e53ed86c147d4af498b8ccce2d814, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/b37fffae6f454d15909282e7d45d90ec, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/26d348106bb5467691376f9ca81cdc5c, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/f062fb65073349818fda9f09c53cdbec, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/93fc037f3bdc4b18b5235a9f00fc4843, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/0ad7c97a8853413fbe077e1a1b766357, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/04662500326b4a609ce4fb05638a266a_SeqId_44_] to archive 2023-03-07 10:53:49,381 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:53:49,384 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/128c8660a1764f93a3ecb2bf0799088a to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/128c8660a1764f93a3ecb2bf0799088a 2023-03-07 10:53:49,385 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/1f78aa27ec404beb89667c1f458a9b95 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/1f78aa27ec404beb89667c1f458a9b95 2023-03-07 10:53:49,387 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/e5f33e28b47343259bd460944a550f1e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/e5f33e28b47343259bd460944a550f1e 2023-03-07 10:53:49,388 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/d94e53ed86c147d4af498b8ccce2d814 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/d94e53ed86c147d4af498b8ccce2d814 2023-03-07 10:53:49,390 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/b37fffae6f454d15909282e7d45d90ec to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/b37fffae6f454d15909282e7d45d90ec 2023-03-07 10:53:49,391 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/26d348106bb5467691376f9ca81cdc5c to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/26d348106bb5467691376f9ca81cdc5c 2023-03-07 10:53:49,393 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/f062fb65073349818fda9f09c53cdbec to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/f062fb65073349818fda9f09c53cdbec 2023-03-07 10:53:49,395 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/93fc037f3bdc4b18b5235a9f00fc4843 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/93fc037f3bdc4b18b5235a9f00fc4843 2023-03-07 10:53:49,396 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/0ad7c97a8853413fbe077e1a1b766357 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/0ad7c97a8853413fbe077e1a1b766357 2023-03-07 10:53:49,397 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/04662500326b4a609ce4fb05638a266a_SeqId_44_ to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/04662500326b4a609ce4fb05638a266a_SeqId_44_ 2023-03-07 10:53:50,129 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c76e4c0e3a874825b62ea570811319b3 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205c76e4c0e3a874825b62ea570811319b3 2023-03-07 10:53:50,131 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-07 10:53:50,164 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/92242afe8a7445d39d8946744b7baf9e first=Optional[r00] last=Optional[r2] 2023-03-07 10:53:50,165 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/92242afe8a7445d39d8946744b7baf9e}] 2023-03-07 10:53:50,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/92242afe8a7445d39d8946744b7baf9e for inclusion in d3470e709599a35cac3d1337722546a9/family1 2023-03-07 10:53:50,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-07 10:53:50,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(777): Region bounds: first= last= 2023-03-07 10:53:50,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for d3470e709599a35cac3d1337722546a9: 2023-03-07 10:53:50,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/92242afe8a7445d39d8946744b7baf9e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__f4g2kgskhpje7qp50ser0t2dokaetbvgq9rh89ovq4pttnjjkr3stvc3216ih575/family1/92242afe8a7445d39d8946744b7baf9e 2023-03-07 10:53:50,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__f4g2kgskhpje7qp50ser0t2dokaetbvgq9rh89ovq4pttnjjkr3stvc3216ih575/family1/92242afe8a7445d39d8946744b7baf9e as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/ab0cca892cb24d9c872b1bd91f4af326_SeqId_47_ 2023-03-07 10:53:50,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__f4g2kgskhpje7qp50ser0t2dokaetbvgq9rh89ovq4pttnjjkr3stvc3216ih575/family1/92242afe8a7445d39d8946744b7baf9e into d3470e709599a35cac3d1337722546a9/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/ab0cca892cb24d9c872b1bd91f4af326_SeqId_47_ - updating store file list. 2023-03-07 10:53:50,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/ab0cca892cb24d9c872b1bd91f4af326_SeqId_47_ into d3470e709599a35cac3d1337722546a9/family1 2023-03-07 10:53:50,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__f4g2kgskhpje7qp50ser0t2dokaetbvgq9rh89ovq4pttnjjkr3stvc3216ih575/family1/92242afe8a7445d39d8946744b7baf9e into d3470e709599a35cac3d1337722546a9/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/ab0cca892cb24d9c872b1bd91f4af326_SeqId_47_) 2023-03-07 10:53:50,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__f4g2kgskhpje7qp50ser0t2dokaetbvgq9rh89ovq4pttnjjkr3stvc3216ih575/family1/92242afe8a7445d39d8946744b7baf9e 2023-03-07 10:53:50,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-07 10:53:50,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-07 10:53:50,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(1912): d3470e709599a35cac3d1337722546a9/family1 is initiating minor compaction (all files) 2023-03-07 10:53:50,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3a585e35; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:53:50,188 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d3470e709599a35cac3d1337722546a9/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:50,189 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/2d050c566c214320a2fa891001b07e04, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/b128eec54ac647889a50cfc9606598d9, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/ab0cca892cb24d9c872b1bd91f4af326_SeqId_47_] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/.tmp, totalSize=358.6 K 2023-03-07 10:53:50,189 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 2d050c566c214320a2fa891001b07e04, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878838856 2023-03-07 10:53:50,190 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting b128eec54ac647889a50cfc9606598d9, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621238856 2023-03-07 10:53:50,191 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting ab0cca892cb24d9c872b1bd91f4af326_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878838856 2023-03-07 10:53:50,191 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-07 10:53:50,193 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:53:50,195 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130a63fb4cb74134ce8a48dfc2d74c6c6e1 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130a63fb4cb74134ce8a48dfc2d74c6c6e1 2023-03-07 10:53:50,198 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201fb7765f3bcbb45d682882ff6586fe299 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201fb7765f3bcbb45d682882ff6586fe299 2023-03-07 10:53:50,200 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205034997e5c8f44fb58adfc46fb0039fa2 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205034997e5c8f44fb58adfc46fb0039fa2 2023-03-07 10:53:50,200 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-03-07 10:53:50,200 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-07 10:53:50,200 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-07 10:53:50,200 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-07 10:53:50,201 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:53:50,202 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-07 10:53:50,204 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 2.1410 sec 2023-03-07 10:53:50,232 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] throttle.PressureAwareThroughputController(145): d3470e709599a35cac3d1337722546a9#family1#compaction#11 average throughput is 6.61 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:53:50,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-07 10:53:50,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:50,399 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-03-07 10:53:50,401 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-03-07 10:53:50,401 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-03-07 10:53:50,407 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-03-07 10:53:50,428 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=d3470e709599a35cac3d1337722546a9, REOPEN/MOVE}] 2023-03-07 10:53:50,430 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=d3470e709599a35cac3d1337722546a9, REOPEN/MOVE 2023-03-07 10:53:50,431 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=d3470e709599a35cac3d1337722546a9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:50,432 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678186430431"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186430431"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186430431"}]},"ts":"1678186430431"} 2023-03-07 10:53:50,435 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure d3470e709599a35cac3d1337722546a9, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:53:50,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d3470e709599a35cac3d1337722546a9 2023-03-07 10:53:50,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d3470e709599a35cac3d1337722546a9, disabling compactions & flushes 2023-03-07 10:53:50,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:51,467 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/.tmp/family1/74134131e305484580dae4e601a4e58e as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/74134131e305484580dae4e601a4e58e 2023-03-07 10:53:51,474 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in d3470e709599a35cac3d1337722546a9/family1 of d3470e709599a35cac3d1337722546a9 into 74134131e305484580dae4e601a4e58e(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-07 10:53:51,474 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d3470e709599a35cac3d1337722546a9: 2023-03-07 10:53:51,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:51,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:51,475 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1678186430188; duration=1sec 2023-03-07 10:53:51,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. after waiting 0 ms 2023-03-07 10:53:51,475 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:53:51,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:51,478 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/2d050c566c214320a2fa891001b07e04, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/b128eec54ac647889a50cfc9606598d9, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/ab0cca892cb24d9c872b1bd91f4af326_SeqId_47_] to archive 2023-03-07 10:53:51,479 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:53:51,481 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/2d050c566c214320a2fa891001b07e04 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/2d050c566c214320a2fa891001b07e04 2023-03-07 10:53:51,483 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/b128eec54ac647889a50cfc9606598d9 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/b128eec54ac647889a50cfc9606598d9 2023-03-07 10:53:51,485 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/ab0cca892cb24d9c872b1bd91f4af326_SeqId_47_ to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/ab0cca892cb24d9c872b1bd91f4af326_SeqId_47_ 2023-03-07 10:53:51,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-07 10:53:51,492 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:51,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d3470e709599a35cac3d1337722546a9: 2023-03-07 10:53:51,492 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: d3470e709599a35cac3d1337722546a9 to self. 2023-03-07 10:53:51,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d3470e709599a35cac3d1337722546a9 2023-03-07 10:53:51,495 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=d3470e709599a35cac3d1337722546a9, regionState=CLOSED 2023-03-07 10:53:51,495 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678186431495"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186431495"}]},"ts":"1678186431495"} 2023-03-07 10:53:51,499 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-03-07 10:53:51,499 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure d3470e709599a35cac3d1337722546a9, server=jenkins-hbase4.apache.org,39673,1678186416064 in 1.0620 sec 2023-03-07 10:53:51,499 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=d3470e709599a35cac3d1337722546a9, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,39673,1678186416064; forceNewPlan=false, retain=true 2023-03-07 10:53:51,650 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=d3470e709599a35cac3d1337722546a9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:51,650 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678186431650"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186431650"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186431650"}]},"ts":"1678186431650"} 2023-03-07 10:53:51,653 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure d3470e709599a35cac3d1337722546a9, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:53:51,809 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:51,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d3470e709599a35cac3d1337722546a9, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9.', STARTKEY => '', ENDKEY => ''} 2023-03-07 10:53:51,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly d3470e709599a35cac3d1337722546a9 2023-03-07 10:53:51,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:53:51,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d3470e709599a35cac3d1337722546a9 2023-03-07 10:53:51,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d3470e709599a35cac3d1337722546a9 2023-03-07 10:53:51,811 INFO [StoreOpener-d3470e709599a35cac3d1337722546a9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d3470e709599a35cac3d1337722546a9 2023-03-07 10:53:51,812 DEBUG [StoreOpener-d3470e709599a35cac3d1337722546a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1 2023-03-07 10:53:51,812 DEBUG [StoreOpener-d3470e709599a35cac3d1337722546a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1 2023-03-07 10:53:51,812 INFO [StoreOpener-d3470e709599a35cac3d1337722546a9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d3470e709599a35cac3d1337722546a9 columnFamilyName family1 2023-03-07 10:53:51,819 DEBUG [StoreOpener-d3470e709599a35cac3d1337722546a9-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/74134131e305484580dae4e601a4e58e 2023-03-07 10:53:51,820 INFO [StoreOpener-d3470e709599a35cac3d1337722546a9-1] regionserver.HStore(310): Store=d3470e709599a35cac3d1337722546a9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:53:51,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9 2023-03-07 10:53:51,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9 2023-03-07 10:53:51,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d3470e709599a35cac3d1337722546a9 2023-03-07 10:53:51,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d3470e709599a35cac3d1337722546a9; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67789453, jitterRate=0.010141566395759583}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-07 10:53:51,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d3470e709599a35cac3d1337722546a9: 2023-03-07 10:53:51,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9., pid=17, masterSystemTime=1678186431805 2023-03-07 10:53:51,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:51,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:53:51,829 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=d3470e709599a35cac3d1337722546a9, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:51,829 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678186431829"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186431829"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186431829"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186431829"}]},"ts":"1678186431829"} 2023-03-07 10:53:51,833 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-03-07 10:53:51,833 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure d3470e709599a35cac3d1337722546a9, server=jenkins-hbase4.apache.org,39673,1678186416064 in 178 msec 2023-03-07 10:53:51,835 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-03-07 10:53:51,835 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=d3470e709599a35cac3d1337722546a9, REOPEN/MOVE in 1.4050 sec 2023-03-07 10:53:51,839 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-03-07 10:53:51,839 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.4310 sec 2023-03-07 10:53:51,841 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.4720 sec 2023-03-07 10:53:51,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-03-07 10:53:51,850 INFO [Listener at localhost/42383] compactions.TestMobCompactor(278): alter status finished 2023-03-07 10:53:51,851 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45579] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-07 10:53:51,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-07 10:53:51,854 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-07 10:53:51,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:53:51,854 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678187031854 2023-03-07 10:53:51,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-07 10:53:51,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-03-07 10:53:51,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-07 10:53:51,857 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] zookeeper.ReadOnlyZKClient(139): Connect 0x1859258b to 127.0.0.1:56055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-07 10:53:51,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@159b0e5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-07 10:53:51,862 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-07 10:53:51,862 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-07 10:53:51,862 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-07 10:53:51,862 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-07 10:53:51,862 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-07 10:53:52,697 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128913a4d55780649bd87b5d7a44c2d3ebb to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128913a4d55780649bd87b5d7a44c2d3ebb 2023-03-07 10:53:52,699 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-07 10:53:52,712 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-07 10:53:52,713 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52144, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-07 10:53:52,721 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-07 10:53:52,723 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44080, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-07 10:53:52,734 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/3dc134a2df0c41eeb8ca7f1941bea6d8 first=Optional[r05] last=Optional[r8] 2023-03-07 10:53:52,734 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=51 for row with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/3dc134a2df0c41eeb8ca7f1941bea6d8}] 2023-03-07 10:53:52,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/3dc134a2df0c41eeb8ca7f1941bea6d8 for inclusion in d3470e709599a35cac3d1337722546a9/family1 2023-03-07 10:53:52,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-07 10:53:52,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(777): Region bounds: first= last= 2023-03-07 10:53:52,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for d3470e709599a35cac3d1337722546a9: 2023-03-07 10:53:52,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/3dc134a2df0c41eeb8ca7f1941bea6d8 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__497lje816bp4q4166nvj17ilanfu17qt4u8852bhdribh0ah5oir3iqntj6gdq4a/family1/3dc134a2df0c41eeb8ca7f1941bea6d8 2023-03-07 10:53:52,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__497lje816bp4q4166nvj17ilanfu17qt4u8852bhdribh0ah5oir3iqntj6gdq4a/family1/3dc134a2df0c41eeb8ca7f1941bea6d8 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/7a64279279cd400c871b719fce39f6a0_SeqId_53_ 2023-03-07 10:53:52,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__497lje816bp4q4166nvj17ilanfu17qt4u8852bhdribh0ah5oir3iqntj6gdq4a/family1/3dc134a2df0c41eeb8ca7f1941bea6d8 into d3470e709599a35cac3d1337722546a9/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/7a64279279cd400c871b719fce39f6a0_SeqId_53_ - updating store file list. 2023-03-07 10:53:52,753 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/7a64279279cd400c871b719fce39f6a0_SeqId_53_ into d3470e709599a35cac3d1337722546a9/family1 2023-03-07 10:53:52,753 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__497lje816bp4q4166nvj17ilanfu17qt4u8852bhdribh0ah5oir3iqntj6gdq4a/family1/3dc134a2df0c41eeb8ca7f1941bea6d8 into d3470e709599a35cac3d1337722546a9/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/family1/7a64279279cd400c871b719fce39f6a0_SeqId_53_) 2023-03-07 10:53:52,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__497lje816bp4q4166nvj17ilanfu17qt4u8852bhdribh0ah5oir3iqntj6gdq4a/family1/3dc134a2df0c41eeb8ca7f1941bea6d8 2023-03-07 10:53:52,756 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-07 10:53:52,757 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:53:52,759 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120aed7284f6c19499e84fbdaa6b0c4895e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120aed7284f6c19499e84fbdaa6b0c4895e 2023-03-07 10:53:52,760 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511285bf09cc2051e4db3918201882eafeb58 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511285bf09cc2051e4db3918201882eafeb58 2023-03-07 10:53:52,760 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-03-07 10:53:52,761 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-07 10:53:52,761 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-07 10:53:52,761 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-07 10:53:52,761 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-07 10:53:52,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-07 10:53:52,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:53:52,762 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-07 10:53:52,764 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 910 msec 2023-03-07 10:53:52,838 INFO [Listener at localhost/42383] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=250 (was 212) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:38306 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/cluster_071bbff6-8e10-d123-7f15-b1e31d2cd3b7/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5069f42d-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:38442 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:38492 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:38510 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:38572 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56055@0x1859258b-SendThread(127.0.0.1:56055) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:38584 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56055@0x1859258b-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56055@0x1859258b sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1994893333.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:38388 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:38380 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/cluster_071bbff6-8e10-d123-7f15-b1e31d2cd3b7/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56055@0x70134324-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RS:0;jenkins-hbase4:39673-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-49182198_15 at /127.0.0.1:38382 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:38348 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6e2abad0-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:38454 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:38450 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5069f42d-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56055@0x70134324 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1994893333.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6e2abad0-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:38324 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:38540 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6e2abad0-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:38372 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56055@0x70134324-SendThread(127.0.0.1:56055) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:38402 [Waiting for operation #22] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=593 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=315 (was 340), ProcessCount=171 (was 171), AvailableMemoryMB=9447 (was 9816) 2023-03-07 10:53:52,851 INFO [Listener at localhost/42383] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=250, OpenFileDescriptor=593, MaxFileDescriptor=60000, SystemLoadAverage=315, ProcessCount=171, AvailableMemoryMB=9446 2023-03-07 10:53:52,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-07 10:53:52,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:52,856 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-07 10:53:52,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-03-07 10:53:52,857 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-07 10:53:52,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-07 10:53:52,859 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08 2023-03-07 10:53:52,859 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08 empty. 2023-03-07 10:53:52,860 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08 2023-03-07 10:53:52,860 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-03-07 10:53:52,869 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-07 10:53:52,870 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 40137ae7c4e46565e6468a174a44ce08, NAME => 'testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp 2023-03-07 10:53:52,877 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:53:52,877 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 40137ae7c4e46565e6468a174a44ce08, disabling compactions & flushes 2023-03-07 10:53:52,877 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:53:52,877 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:53:52,878 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. after waiting 0 ms 2023-03-07 10:53:52,878 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:53:52,878 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:53:52,878 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 40137ae7c4e46565e6468a174a44ce08: 2023-03-07 10:53:52,881 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-07 10:53:52,882 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678186432881"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186432881"}]},"ts":"1678186432881"} 2023-03-07 10:53:52,884 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-07 10:53:52,885 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-07 10:53:52,885 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186432885"}]},"ts":"1678186432885"} 2023-03-07 10:53:52,886 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-03-07 10:53:52,950 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=40137ae7c4e46565e6468a174a44ce08, ASSIGN}] 2023-03-07 10:53:52,952 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=40137ae7c4e46565e6468a174a44ce08, ASSIGN 2023-03-07 10:53:52,953 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=40137ae7c4e46565e6468a174a44ce08, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39673,1678186416064; forceNewPlan=false, retain=false 2023-03-07 10:53:52,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-07 10:53:53,104 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=40137ae7c4e46565e6468a174a44ce08, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:53,104 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678186433104"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186433104"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186433104"}]},"ts":"1678186433104"} 2023-03-07 10:53:53,106 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 40137ae7c4e46565e6468a174a44ce08, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:53:53,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-07 10:53:53,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:53:53,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 40137ae7c4e46565e6468a174a44ce08, NAME => 'testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08.', STARTKEY => '', ENDKEY => ''} 2023-03-07 10:53:53,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 40137ae7c4e46565e6468a174a44ce08 2023-03-07 10:53:53,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:53:53,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 40137ae7c4e46565e6468a174a44ce08 2023-03-07 10:53:53,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 40137ae7c4e46565e6468a174a44ce08 2023-03-07 10:53:53,265 INFO [StoreOpener-40137ae7c4e46565e6468a174a44ce08-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 40137ae7c4e46565e6468a174a44ce08 2023-03-07 10:53:53,266 DEBUG [StoreOpener-40137ae7c4e46565e6468a174a44ce08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1 2023-03-07 10:53:53,266 DEBUG [StoreOpener-40137ae7c4e46565e6468a174a44ce08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1 2023-03-07 10:53:53,266 INFO [StoreOpener-40137ae7c4e46565e6468a174a44ce08-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 40137ae7c4e46565e6468a174a44ce08 columnFamilyName family1 2023-03-07 10:53:53,268 INFO [StoreOpener-40137ae7c4e46565e6468a174a44ce08-1] regionserver.HStore(310): Store=40137ae7c4e46565e6468a174a44ce08/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:53:53,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08 2023-03-07 10:53:53,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08 2023-03-07 10:53:53,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 40137ae7c4e46565e6468a174a44ce08 2023-03-07 10:53:53,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-07 10:53:53,274 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 40137ae7c4e46565e6468a174a44ce08; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62891821, jitterRate=-0.0628388375043869}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-07 10:53:53,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 40137ae7c4e46565e6468a174a44ce08: 2023-03-07 10:53:53,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08., pid=21, masterSystemTime=1678186433259 2023-03-07 10:53:53,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:53:53,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:53:53,278 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=40137ae7c4e46565e6468a174a44ce08, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:53,278 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678186433278"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186433278"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186433278"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186433278"}]},"ts":"1678186433278"} 2023-03-07 10:53:53,282 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-03-07 10:53:53,282 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 40137ae7c4e46565e6468a174a44ce08, server=jenkins-hbase4.apache.org,39673,1678186416064 in 174 msec 2023-03-07 10:53:53,284 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-03-07 10:53:53,284 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=40137ae7c4e46565e6468a174a44ce08, ASSIGN in 332 msec 2023-03-07 10:53:53,284 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-07 10:53:53,285 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186433284"}]},"ts":"1678186433284"} 2023-03-07 10:53:53,286 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-03-07 10:53:53,288 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-07 10:53:53,290 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 435 msec 2023-03-07 10:53:53,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-07 10:53:53,461 INFO [Listener at localhost/42383] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-03-07 10:53:53,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:53:53,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,496 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-07 10:53:53,496 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:53,497 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-07 10:53:53,497 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-07 10:53:53,497 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,498 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,499 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:53,499 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:53,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:53,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:53,499 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:53,499 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:53:53,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,500 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:53:53,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,500 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,500 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,500 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-07 10:53:53,500 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:53,501 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-07 10:53:53,501 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:53:53,501 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:53:53,501 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:53:53,501 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. started... 2023-03-07 10:53:53,502 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 40137ae7c4e46565e6468a174a44ce08 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-07 10:53:53,926 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511300a815b2bd52b4f5c9f0e41430cda23a3 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511300a815b2bd52b4f5c9f0e41430cda23a3 2023-03-07 10:53:53,930 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/.tmp/family1/8b17e16efdc64b10811db2ee17e04daa 2023-03-07 10:53:53,936 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/.tmp/family1/8b17e16efdc64b10811db2ee17e04daa as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/8b17e16efdc64b10811db2ee17e04daa 2023-03-07 10:53:53,943 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/8b17e16efdc64b10811db2ee17e04daa, entries=1000, sequenceid=5, filesize=166.0 K 2023-03-07 10:53:53,944 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 40137ae7c4e46565e6468a174a44ce08 in 442ms, sequenceid=5, compaction requested=false 2023-03-07 10:53:53,944 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-03-07 10:53:53,945 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 40137ae7c4e46565e6468a174a44ce08: 2023-03-07 10:53:53,945 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:53:53,945 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:53:53,945 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:53:53,945 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:53,945 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-07 10:53:53,945 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-07 10:53:53,947 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,947 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:53,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:53,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:53,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:53,948 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,948 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:53:53,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:53,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:53,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:53,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:53,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-07 10:53:53,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49b35423[Count = 0] remaining members to acquire global barrier 2023-03-07 10:53:53,950 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-07 10:53:53,950 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,956 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,956 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-07 10:53:53,956 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-07 10:53:53,956 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:53:53,956 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:53,956 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:53:53,958 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-07 10:53:53,958 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:53,958 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:53,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:53,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:53,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:53,958 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-07 10:53:53,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:53,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:53,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:53,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:53,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:53,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:53:53,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:53:53,961 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-07 10:53:53,961 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:53:53,961 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:53:53,961 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,961 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:53:53,963 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,963 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:53,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:53,963 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:53,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:53,963 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:53,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:53,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:53,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:53,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,965 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:53,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:53,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:53,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:53,967 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:53,967 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:53,967 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,967 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:53,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:53,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:53,967 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-07 10:53:53,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:53:53,967 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:53,967 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:53,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:53,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:53,968 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,968 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,968 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:53,968 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:53:53,969 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:53:54,069 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:53:54,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:53:54,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:53:54,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:53:54,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,077 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-07 10:53:54,077 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:54,078 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-07 10:53:54,078 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-07 10:53:54,079 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,079 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,080 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:54,081 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:54,081 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:54,081 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:53:54,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:54,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:54,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,082 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:53:54,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,082 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,083 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-07 10:53:54,083 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,083 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-07 10:53:54,083 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:54,083 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-07 10:53:54,083 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:53:54,084 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:53:54,084 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:53:54,084 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. started... 2023-03-07 10:53:54,084 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 40137ae7c4e46565e6468a174a44ce08 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-07 10:53:54,110 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112807d24cf09c634e19bec540d00d7b13f3 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112807d24cf09c634e19bec540d00d7b13f3 2023-03-07 10:53:54,120 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/.tmp/family1/ab0bd0d0583445999e254eb0f8781f23 2023-03-07 10:53:54,127 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/.tmp/family1/ab0bd0d0583445999e254eb0f8781f23 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/ab0bd0d0583445999e254eb0f8781f23 2023-03-07 10:53:54,133 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/ab0bd0d0583445999e254eb0f8781f23, entries=1, sequenceid=9, filesize=5.0 K 2023-03-07 10:53:54,135 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 40137ae7c4e46565e6468a174a44ce08 in 51ms, sequenceid=9, compaction requested=false 2023-03-07 10:53:54,135 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 40137ae7c4e46565e6468a174a44ce08: 2023-03-07 10:53:54,135 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:53:54,135 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:53:54,135 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:53:54,135 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:54,135 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-07 10:53:54,135 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-07 10:53:54,137 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,137 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:54,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:54,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:54,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:54,138 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,138 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:53:54,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:54,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:54,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:54,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:54,140 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-07 10:53:54,140 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27fcdf0f[Count = 0] remaining members to acquire global barrier 2023-03-07 10:53:54,140 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-07 10:53:54,140 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,142 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,142 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-07 10:53:54,142 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-07 10:53:54,142 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:53:54,142 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:54,142 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:53:54,144 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:54,144 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-07 10:53:54,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:54,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:54,144 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:54,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:54,144 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-07 10:53:54,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:54,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:54,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:54,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:54,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:54,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:53:54,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:53:54,147 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-07 10:53:54,147 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:53:54,148 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:53:54,148 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,148 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:53:54,154 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,154 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:54,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:54,154 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:54,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:54,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:54,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:54,155 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:54,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:54,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:54,158 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:54,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:54,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:54,168 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:54,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:54,168 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:54,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-07 10:53:54,168 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,168 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:54,169 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,170 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:54,170 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,170 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:53:54,168 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:54,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:54,170 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-07 10:53:54,170 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:54,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:54,171 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:53:54,171 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:53:54,271 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:53:54,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:53:54,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:53:54,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:53:54,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,278 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-07 10:53:54,278 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:54,279 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-07 10:53:54,279 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-07 10:53:54,279 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,279 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,281 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:54,281 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:54,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:54,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:54,281 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:54,281 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:53:54,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,281 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:53:54,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,282 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,282 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-07 10:53:54,282 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:54,282 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-07 10:53:54,282 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:54,283 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-07 10:53:54,283 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:53:54,283 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:53:54,283 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:53:54,283 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. started... 2023-03-07 10:53:54,283 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 40137ae7c4e46565e6468a174a44ce08 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:53:54,698 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512014df2900f349746c6b21381267fc0fa3f to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512014df2900f349746c6b21381267fc0fa3f 2023-03-07 10:53:55,104 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/.tmp/family1/1f196730e73440ebb6c03642ce6ae809 2023-03-07 10:53:55,111 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/.tmp/family1/1f196730e73440ebb6c03642ce6ae809 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/1f196730e73440ebb6c03642ce6ae809 2023-03-07 10:53:55,116 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/1f196730e73440ebb6c03642ce6ae809, entries=1, sequenceid=13, filesize=4.9 K 2023-03-07 10:53:55,117 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 40137ae7c4e46565e6468a174a44ce08 in 834ms, sequenceid=13, compaction requested=true 2023-03-07 10:53:55,118 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 40137ae7c4e46565e6468a174a44ce08: 2023-03-07 10:53:55,118 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:53:55,118 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:53:55,118 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:53:55,118 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,118 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-07 10:53:55,118 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-07 10:53:55,120 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,120 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:55,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:55,120 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,120 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:53:55,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:55,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:55,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:55,122 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-07 10:53:55,122 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78129150[Count = 0] remaining members to acquire global barrier 2023-03-07 10:53:55,122 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-07 10:53:55,122 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,123 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,123 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-07 10:53:55,123 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-07 10:53:55,123 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,123 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:53:55,123 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:53:55,125 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-07 10:53:55,125 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:55,125 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,125 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-07 10:53:55,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:55,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:55,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:55,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:55,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:55,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:53:55,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:53:55,128 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-07 10:53:55,128 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:53:55,128 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:53:55,128 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,128 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:53:55,131 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,131 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:55,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:55,131 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:55,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:55,131 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:55,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:55,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:55,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,133 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:55,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,135 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,135 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:55,135 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,135 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:55,135 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:55,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-07 10:53:55,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:53:55,135 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:55,136 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:55,136 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,136 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,136 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,136 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:53:55,136 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:53:55,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:55,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:55,236 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:53:55,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:53:55,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:53:55,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:53:55,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,244 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-07 10:53:55,244 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:55,244 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-07 10:53:55,244 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-07 10:53:55,245 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,245 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,246 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:55,246 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:55,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:55,246 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,246 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:53:55,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,247 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:53:55,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,247 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,247 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-07 10:53:55,247 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,247 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-07 10:53:55,248 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:55,248 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-07 10:53:55,248 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:53:55,248 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:53:55,248 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:53:55,248 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. started... 2023-03-07 10:53:55,248 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 40137ae7c4e46565e6468a174a44ce08 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:53:55,669 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c18591de0fb541019a0ff02c3bb1e21f to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205c18591de0fb541019a0ff02c3bb1e21f 2023-03-07 10:53:55,678 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/.tmp/family1/03852f41dc2c418885ab846d1d6b7ede 2023-03-07 10:53:55,687 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/.tmp/family1/03852f41dc2c418885ab846d1d6b7ede as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/03852f41dc2c418885ab846d1d6b7ede 2023-03-07 10:53:55,692 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/03852f41dc2c418885ab846d1d6b7ede, entries=1, sequenceid=17, filesize=4.9 K 2023-03-07 10:53:55,694 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 40137ae7c4e46565e6468a174a44ce08 in 446ms, sequenceid=17, compaction requested=true 2023-03-07 10:53:55,694 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 40137ae7c4e46565e6468a174a44ce08: 2023-03-07 10:53:55,694 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:53:55,694 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:53:55,694 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:53:55,694 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,694 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-07 10:53:55,694 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-07 10:53:55,696 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,696 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:55,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:55,696 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,696 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:53:55,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:55,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:55,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:55,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-07 10:53:55,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c90ef1d[Count = 0] remaining members to acquire global barrier 2023-03-07 10:53:55,698 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-07 10:53:55,698 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,699 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,699 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-07 10:53:55,699 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-07 10:53:55,700 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:53:55,700 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,700 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:53:55,701 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-07 10:53:55,701 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,701 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:55,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:55,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:55,701 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-07 10:53:55,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:55,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:55,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:55,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:53:55,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:53:55,704 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-07 10:53:55,705 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:53:55,705 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:53:55,705 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,705 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:53:55,707 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,707 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:55,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:55,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,707 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:55,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,708 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:55,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:55,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:55,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:55,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,709 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:55,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,711 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:55,712 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:55,712 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:55,712 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:55,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-07 10:53:55,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:53:55,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:55,712 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,712 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,713 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,713 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,713 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,713 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,713 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:53:55,713 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:53:55,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:55,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:55,813 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:53:55,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:53:55,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:53:55,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:53:55,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,820 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-07 10:53:55,820 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:55,821 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-07 10:53:55,821 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-07 10:53:55,821 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,821 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,823 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,823 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:55,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:55,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:55,823 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:55,823 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:53:55,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,823 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:53:55,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,824 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,824 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-07 10:53:55,824 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:55,824 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-07 10:53:55,824 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:55,825 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-07 10:53:55,825 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:53:55,825 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:53:55,825 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:53:55,825 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. started... 2023-03-07 10:53:55,825 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 40137ae7c4e46565e6468a174a44ce08 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:53:56,239 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122830cb922d04d744bfa0e0595f1793e90c to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122830cb922d04d744bfa0e0595f1793e90c 2023-03-07 10:53:56,645 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/.tmp/family1/a28f471173c043078fa5a3ee73c90fc9 2023-03-07 10:53:56,651 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/.tmp/family1/a28f471173c043078fa5a3ee73c90fc9 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/a28f471173c043078fa5a3ee73c90fc9 2023-03-07 10:53:56,656 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/a28f471173c043078fa5a3ee73c90fc9, entries=1, sequenceid=21, filesize=4.9 K 2023-03-07 10:53:56,657 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 40137ae7c4e46565e6468a174a44ce08 in 832ms, sequenceid=21, compaction requested=true 2023-03-07 10:53:56,657 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 40137ae7c4e46565e6468a174a44ce08: 2023-03-07 10:53:56,657 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:53:56,657 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:53:56,657 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:53:56,657 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:56,657 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-07 10:53:56,657 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-07 10:53:56,659 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,659 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:56,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:56,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:56,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:56,659 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,659 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:53:56,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:56,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:56,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:56,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:56,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-07 10:53:56,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f51a0e0[Count = 0] remaining members to acquire global barrier 2023-03-07 10:53:56,661 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-07 10:53:56,661 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,664 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,664 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-07 10:53:56,664 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-07 10:53:56,664 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:56,664 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:53:56,664 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:53:56,666 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:56,666 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-07 10:53:56,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:56,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:56,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:56,666 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:56,666 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-07 10:53:56,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:56,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:56,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:56,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:56,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:56,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:53:56,668 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:53:56,668 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-07 10:53:56,669 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:53:56,669 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:53:56,669 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,669 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:53:56,673 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,673 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:56,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:56,673 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:56,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:56,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:56,674 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:56,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:56,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:56,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,675 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:56,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:56,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:56,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:56,678 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:56,678 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:56,678 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,678 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:56,679 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:56,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-07 10:53:56,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:53:56,679 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:56,679 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:56,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:56,680 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:53:56,679 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,680 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:53:56,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:56,680 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-07 10:53:56,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:56,680 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,680 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,780 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:53:56,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:53:56,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:53:56,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:53:56,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,788 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-07 10:53:56,788 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:56,788 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-07 10:53:56,788 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-07 10:53:56,789 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,789 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,791 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:56,791 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:56,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:56,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:56,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,792 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:56,792 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:53:56,792 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:53:56,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,792 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,793 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-07 10:53:56,793 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:56,793 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-07 10:53:56,793 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:56,793 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-07 10:53:56,794 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:53:56,794 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:53:56,794 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:53:56,794 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. started... 2023-03-07 10:53:56,794 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 40137ae7c4e46565e6468a174a44ce08 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:53:57,021 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-07 10:53:57,215 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512313737543938314cbe9fe96bfab870df86 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512313737543938314cbe9fe96bfab870df86 2023-03-07 10:53:57,621 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/.tmp/family1/bd0b62db30c347f1850b5279e9529b92 2023-03-07 10:53:57,628 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/.tmp/family1/bd0b62db30c347f1850b5279e9529b92 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/bd0b62db30c347f1850b5279e9529b92 2023-03-07 10:53:57,633 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/bd0b62db30c347f1850b5279e9529b92, entries=1, sequenceid=25, filesize=4.9 K 2023-03-07 10:53:57,634 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 40137ae7c4e46565e6468a174a44ce08 in 840ms, sequenceid=25, compaction requested=true 2023-03-07 10:53:57,634 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 40137ae7c4e46565e6468a174a44ce08: 2023-03-07 10:53:57,634 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:53:57,634 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:53:57,634 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:53:57,634 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:57,634 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-07 10:53:57,634 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-07 10:53:57,636 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:57,636 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:57,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:57,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:57,636 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,636 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:53:57,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:57,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:57,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:57,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:57,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-07 10:53:57,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e9408a2[Count = 0] remaining members to acquire global barrier 2023-03-07 10:53:57,638 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-07 10:53:57,638 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,640 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,640 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-07 10:53:57,640 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-07 10:53:57,641 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:53:57,641 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:57,641 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:53:57,642 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-07 10:53:57,642 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:57,642 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:57,642 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-07 10:53:57,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:57,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:57,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:57,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:57,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:57,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:57,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:57,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:57,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:53:57,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:53:57,645 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-07 10:53:57,645 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:53:57,645 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:53:57,645 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,645 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:53:57,647 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,647 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,647 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:57,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:57,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:57,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:57,647 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:57,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:57,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:57,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:57,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,648 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:57,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:57,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:57,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:57,651 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:57,651 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,651 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,651 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:57,651 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:57,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:57,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-07 10:53:57,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:57,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-07 10:53:57,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:53:57,651 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:57,651 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,651 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,651 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:57,652 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:53:57,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:57,652 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:57,652 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:53:57,752 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:53:57,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:53:57,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:53:57,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:53:57,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,760 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-07 10:53:57,760 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:57,760 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-07 10:53:57,760 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-07 10:53:57,761 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,761 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,763 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:57,763 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:57,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:57,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:57,763 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:57,763 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:53:57,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:53:57,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,764 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,764 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-07 10:53:57,764 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:57,764 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-07 10:53:57,764 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:57,765 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-07 10:53:57,765 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:53:57,765 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:53:57,765 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:53:57,765 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. started... 2023-03-07 10:53:57,765 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 40137ae7c4e46565e6468a174a44ce08 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:53:58,180 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010122e0ba09141e4772943da71e6b243b36 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010122e0ba09141e4772943da71e6b243b36 2023-03-07 10:53:58,586 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/.tmp/family1/9f88afbfdd87480f946b311bcd62e123 2023-03-07 10:53:58,594 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/.tmp/family1/9f88afbfdd87480f946b311bcd62e123 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/9f88afbfdd87480f946b311bcd62e123 2023-03-07 10:53:58,600 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/9f88afbfdd87480f946b311bcd62e123, entries=1, sequenceid=29, filesize=4.9 K 2023-03-07 10:53:58,601 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 40137ae7c4e46565e6468a174a44ce08 in 836ms, sequenceid=29, compaction requested=true 2023-03-07 10:53:58,601 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 40137ae7c4e46565e6468a174a44ce08: 2023-03-07 10:53:58,601 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:53:58,601 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:53:58,601 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:53:58,601 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:58,601 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-07 10:53:58,601 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-07 10:53:58,666 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:58,666 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:58,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:58,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:58,667 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:58,667 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:53:58,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:58,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:58,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:58,668 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-07 10:53:58,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72609231[Count = 0] remaining members to acquire global barrier 2023-03-07 10:53:58,669 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-07 10:53:58,669 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,727 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,728 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-07 10:53:58,728 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-07 10:53:58,728 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:53:58,728 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:58,728 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:53:58,750 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-07 10:53:58,750 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:58,751 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:58,751 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-07 10:53:58,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:58,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:58,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:58,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:58,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:58,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:58,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:58,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:58,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:53:58,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:53:58,754 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-07 10:53:58,754 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:53:58,754 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:53:58,754 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,754 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:53:58,766 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,766 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:58,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:58,766 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:58,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:58,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:58,767 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:58,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:58,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:58,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,769 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:58,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:58,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:58,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:58,797 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:58,797 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:58,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:58,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:58,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-07 10:53:58,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:53:58,798 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,798 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-07 10:53:58,798 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:58,797 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:58,798 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,799 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:58,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:58,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:58,799 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,799 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:53:58,799 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,799 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:53:58,799 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,899 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:53:58,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:53:58,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:53:58,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:53:58,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,909 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-07 10:53:58,909 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:58,910 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-07 10:53:58,910 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-07 10:53:58,910 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,910 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,943 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:58,943 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:58,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:58,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:58,944 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:58,944 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:53:58,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,944 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:53:58,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,945 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,945 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-07 10:53:58,945 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:58,945 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-07 10:53:58,946 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:58,946 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-07 10:53:58,946 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:53:58,947 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:53:58,947 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:53:58,947 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. started... 2023-03-07 10:53:58,947 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 40137ae7c4e46565e6468a174a44ce08 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:53:59,366 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103db6a0f6d012842b9a8d60c3c120db39a to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103db6a0f6d012842b9a8d60c3c120db39a 2023-03-07 10:53:59,773 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/.tmp/family1/91564073bbb5442fbafc9052f3ebefca 2023-03-07 10:53:59,783 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/.tmp/family1/91564073bbb5442fbafc9052f3ebefca as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/91564073bbb5442fbafc9052f3ebefca 2023-03-07 10:53:59,789 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/91564073bbb5442fbafc9052f3ebefca, entries=1, sequenceid=33, filesize=4.9 K 2023-03-07 10:53:59,790 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 40137ae7c4e46565e6468a174a44ce08 in 843ms, sequenceid=33, compaction requested=true 2023-03-07 10:53:59,791 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 40137ae7c4e46565e6468a174a44ce08: 2023-03-07 10:53:59,791 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:53:59,791 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:53:59,791 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:53:59,791 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:59,791 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-07 10:53:59,791 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-07 10:53:59,793 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:59,793 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:59,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:59,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:59,793 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,793 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:53:59,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:59,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:59,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:59,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:59,794 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-07 10:53:59,794 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79836367[Count = 0] remaining members to acquire global barrier 2023-03-07 10:53:59,794 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-07 10:53:59,795 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,796 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,796 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-07 10:53:59,796 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-07 10:53:59,796 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:53:59,796 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:59,796 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:53:59,808 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-07 10:53:59,808 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:59,808 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:59,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:59,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:59,808 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-07 10:53:59,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:59,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:59,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:59,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:59,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:59,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:59,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:53:59,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:53:59,811 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-07 10:53:59,811 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:53:59,811 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:53:59,811 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,811 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:53:59,813 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,813 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,813 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:59,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:53:59,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:53:59,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:59,814 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:59,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:59,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:53:59,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:53:59,815 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:59,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:59,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:53:59,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:59,818 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:59,818 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:59,818 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,818 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:53:59,818 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-07 10:53:59,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:53:59,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:59,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:59,819 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:53:59,819 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:53:59,819 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:53:59,819 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:59,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-07 10:53:59,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:53:59,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:53:59,819 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,819 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,819 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,919 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:53:59,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:53:59,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:53:59,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:53:59,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,928 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-07 10:53:59,928 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:59,929 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-07 10:53:59,929 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-07 10:53:59,929 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,929 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,930 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:53:59,930 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:59,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:53:59,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:53:59,931 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:53:59,931 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:53:59,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,931 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:53:59,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,932 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,932 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-07 10:53:59,932 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-07 10:53:59,932 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-07 10:53:59,932 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:53:59,932 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-07 10:53:59,933 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:53:59,933 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:53:59,933 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:53:59,933 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. started... 2023-03-07 10:53:59,933 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 40137ae7c4e46565e6468a174a44ce08 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:00,351 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907071644c21fba438a848f54931e259093 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907071644c21fba438a848f54931e259093 2023-03-07 10:54:00,363 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/.tmp/family1/29c9dd3f251d438289618400a5148c74 2023-03-07 10:54:00,373 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/.tmp/family1/29c9dd3f251d438289618400a5148c74 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/29c9dd3f251d438289618400a5148c74 2023-03-07 10:54:00,379 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/29c9dd3f251d438289618400a5148c74, entries=1, sequenceid=37, filesize=4.9 K 2023-03-07 10:54:00,380 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 40137ae7c4e46565e6468a174a44ce08 in 447ms, sequenceid=37, compaction requested=true 2023-03-07 10:54:00,380 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 40137ae7c4e46565e6468a174a44ce08: 2023-03-07 10:54:00,380 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:54:00,380 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:00,380 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:00,380 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,380 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-07 10:54:00,380 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-07 10:54:00,383 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,383 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:00,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:00,383 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,383 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:00,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:00,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:00,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:00,385 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-07 10:54:00,385 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b078a17[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:00,385 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-07 10:54:00,385 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,386 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,386 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-07 10:54:00,386 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-07 10:54:00,386 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:00,387 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,387 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:00,388 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-07 10:54:00,388 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,388 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:00,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:00,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:00,388 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-07 10:54:00,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:00,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:00,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:00,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:00,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:54:00,391 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-07 10:54:00,392 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:00,392 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:00,392 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,392 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:00,394 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,394 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,394 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:00,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:00,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:00,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:00,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:00,394 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:00,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:00,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,396 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:00,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,400 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:00,400 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,400 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:00,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:00,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-07 10:54:00,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:00,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:00,400 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:00,400 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,405 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,406 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,406 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,406 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,406 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-07 10:54:00,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:00,406 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,406 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:00,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:00,406 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:00,506 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:00,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:00,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:00,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:00,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,515 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-07 10:54:00,515 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:00,516 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-07 10:54:00,516 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-07 10:54:00,516 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,516 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,517 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,517 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:00,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:00,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:00,518 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,518 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:00,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:00,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,519 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,519 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-07 10:54:00,519 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,519 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-07 10:54:00,519 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:00,521 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-07 10:54:00,521 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:00,521 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:00,521 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:54:00,521 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. started... 2023-03-07 10:54:00,521 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 40137ae7c4e46565e6468a174a44ce08 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:00,943 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511202f351c7ef9dd422fa0b29e0024a4ee91 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511202f351c7ef9dd422fa0b29e0024a4ee91 2023-03-07 10:54:00,955 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/.tmp/family1/ee5d72f1f4c14fc2be1f3e1bfe49c788 2023-03-07 10:54:00,965 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/.tmp/family1/ee5d72f1f4c14fc2be1f3e1bfe49c788 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/ee5d72f1f4c14fc2be1f3e1bfe49c788 2023-03-07 10:54:00,970 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/ee5d72f1f4c14fc2be1f3e1bfe49c788, entries=1, sequenceid=41, filesize=4.9 K 2023-03-07 10:54:00,971 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 40137ae7c4e46565e6468a174a44ce08 in 450ms, sequenceid=41, compaction requested=true 2023-03-07 10:54:00,972 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 40137ae7c4e46565e6468a174a44ce08: 2023-03-07 10:54:00,972 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:54:00,972 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:00,972 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:00,972 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,972 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-07 10:54:00,972 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-07 10:54:00,973 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,973 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:00,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:00,974 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,974 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:00,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:00,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:00,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:00,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-07 10:54:00,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15e846cd[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:00,975 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-07 10:54:00,975 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,977 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,977 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-07 10:54:00,977 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-07 10:54:00,977 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,977 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:00,977 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:00,980 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,980 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-07 10:54:00,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:00,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:00,980 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:00,980 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-07 10:54:00,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:00,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:00,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:00,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:00,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:54:00,983 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-07 10:54:00,983 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:00,983 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:00,983 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,983 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:00,985 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,985 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:00,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:00,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,985 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:00,985 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:00,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:00,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:00,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:00,987 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:00,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,989 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:00,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:00,989 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:00,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:00,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-07 10:54:00,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:00,989 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,989 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:00,990 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:00,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:00,990 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-07 10:54:00,991 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:00,991 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,991 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:00,991 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:00,991 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,991 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:00,991 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:01,091 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:01,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:01,094 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45579] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-03-07 10:54:01,095 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-07 10:54:01,096 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-07 10:54:01,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:54:01,097 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678187041097 2023-03-07 10:54:01,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-07 10:54:01,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-03-07 10:54:01,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-07 10:54:01,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] zookeeper.ReadOnlyZKClient(139): Connect 0x4b654dd9 to 127.0.0.1:56055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-07 10:54:01,104 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77702c8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-07 10:54:01,105 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-07 10:54:01,937 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010385d0283bfeff4cd087b310bd7e7a7f49 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010385d0283bfeff4cd087b310bd7e7a7f49 2023-03-07 10:54:01,938 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-07 10:54:01,951 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-07 10:54:01,952 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37430, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-07 10:54:01,959 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-07 10:54:01,960 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56678, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-07 10:54:01,969 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/aa1b4dac511a420eaa6891f2f83eb2ee first=Optional[r5] last=Optional[r6] 2023-03-07 10:54:01,969 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/aa1b4dac511a420eaa6891f2f83eb2ee}] 2023-03-07 10:54:01,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/aa1b4dac511a420eaa6891f2f83eb2ee for inclusion in 40137ae7c4e46565e6468a174a44ce08/family1 2023-03-07 10:54:01,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-03-07 10:54:01,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(777): Region bounds: first= last= 2023-03-07 10:54:01,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for 40137ae7c4e46565e6468a174a44ce08: 2023-03-07 10:54:01,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/aa1b4dac511a420eaa6891f2f83eb2ee to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__d3kdc2ga1qkn7mh85l4h10rgfaiae8032ilh3m6nuh2peugsve8etmkk42qppsm/family1/aa1b4dac511a420eaa6891f2f83eb2ee 2023-03-07 10:54:01,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__d3kdc2ga1qkn7mh85l4h10rgfaiae8032ilh3m6nuh2peugsve8etmkk42qppsm/family1/aa1b4dac511a420eaa6891f2f83eb2ee as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/e401bf06f2a84a3ca8db40be3c6d6634_SeqId_44_ 2023-03-07 10:54:01,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__d3kdc2ga1qkn7mh85l4h10rgfaiae8032ilh3m6nuh2peugsve8etmkk42qppsm/family1/aa1b4dac511a420eaa6891f2f83eb2ee into 40137ae7c4e46565e6468a174a44ce08/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/e401bf06f2a84a3ca8db40be3c6d6634_SeqId_44_ - updating store file list. 2023-03-07 10:54:01,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/e401bf06f2a84a3ca8db40be3c6d6634_SeqId_44_ into 40137ae7c4e46565e6468a174a44ce08/family1 2023-03-07 10:54:01,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__d3kdc2ga1qkn7mh85l4h10rgfaiae8032ilh3m6nuh2peugsve8etmkk42qppsm/family1/aa1b4dac511a420eaa6891f2f83eb2ee into 40137ae7c4e46565e6468a174a44ce08/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/e401bf06f2a84a3ca8db40be3c6d6634_SeqId_44_) 2023-03-07 10:54:01,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__d3kdc2ga1qkn7mh85l4h10rgfaiae8032ilh3m6nuh2peugsve8etmkk42qppsm/family1/aa1b4dac511a420eaa6891f2f83eb2ee 2023-03-07 10:54:01,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-07 10:54:01,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-07 10:54:01,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(1912): 40137ae7c4e46565e6468a174a44ce08/family1 is initiating minor compaction 2023-03-07 10:54:01,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6305e583; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:54:01,991 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 40137ae7c4e46565e6468a174a44ce08/family1 in testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:54:01,991 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/ab0bd0d0583445999e254eb0f8781f23, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/1f196730e73440ebb6c03642ce6ae809, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/03852f41dc2c418885ab846d1d6b7ede, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/a28f471173c043078fa5a3ee73c90fc9, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/bd0b62db30c347f1850b5279e9529b92, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/9f88afbfdd87480f946b311bcd62e123, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/91564073bbb5442fbafc9052f3ebefca, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/29c9dd3f251d438289618400a5148c74, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/ee5d72f1f4c14fc2be1f3e1bfe49c788, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/e401bf06f2a84a3ca8db40be3c6d6634_SeqId_44_] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/.tmp, totalSize=49.7 K 2023-03-07 10:54:01,991 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting ab0bd0d0583445999e254eb0f8781f23, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-07 10:54:01,991 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 1f196730e73440ebb6c03642ce6ae809, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-07 10:54:01,991 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 03852f41dc2c418885ab846d1d6b7ede, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-07 10:54:01,991 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting a28f471173c043078fa5a3ee73c90fc9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-07 10:54:01,992 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting bd0b62db30c347f1850b5279e9529b92, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-07 10:54:01,992 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 9f88afbfdd87480f946b311bcd62e123, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-07 10:54:01,992 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 91564073bbb5442fbafc9052f3ebefca, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-07 10:54:01,992 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 29c9dd3f251d438289618400a5148c74, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-07 10:54:01,992 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting ee5d72f1f4c14fc2be1f3e1bfe49c788, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-07 10:54:01,992 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting e401bf06f2a84a3ca8db40be3c6d6634_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-07 10:54:01,993 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-07 10:54:01,993 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:54:01,995 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010122e0ba09141e4772943da71e6b243b36 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010122e0ba09141e4772943da71e6b243b36 2023-03-07 10:54:01,997 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103db6a0f6d012842b9a8d60c3c120db39a to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103db6a0f6d012842b9a8d60c3c120db39a 2023-03-07 10:54:01,997 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-03-07 10:54:01,997 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-03-07 10:54:01,997 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-07 10:54:01,997 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-07 10:54:02,029 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] throttle.PressureAwareThroughputController(145): 40137ae7c4e46565e6468a174a44ce08#family1#compaction#22 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:54:02,847 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/.tmp/family1/1dcd992fac8f47059727ffc023b1dc8c as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/1dcd992fac8f47059727ffc023b1dc8c 2023-03-07 10:54:02,847 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231476e1b805e1245498f96f9aaa0d69085 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231476e1b805e1245498f96f9aaa0d69085 2023-03-07 10:54:02,848 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-07 10:54:02,853 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 40137ae7c4e46565e6468a174a44ce08/family1 of 40137ae7c4e46565e6468a174a44ce08 into 1dcd992fac8f47059727ffc023b1dc8c(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-07 10:54:02,854 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 40137ae7c4e46565e6468a174a44ce08: 2023-03-07 10:54:02,854 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1678186441990; duration=0sec 2023-03-07 10:54:02,854 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:54:02,876 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/ab0bd0d0583445999e254eb0f8781f23, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/1f196730e73440ebb6c03642ce6ae809, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/03852f41dc2c418885ab846d1d6b7ede, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/a28f471173c043078fa5a3ee73c90fc9, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/bd0b62db30c347f1850b5279e9529b92, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/9f88afbfdd87480f946b311bcd62e123, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/91564073bbb5442fbafc9052f3ebefca, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/29c9dd3f251d438289618400a5148c74, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/ee5d72f1f4c14fc2be1f3e1bfe49c788, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/e401bf06f2a84a3ca8db40be3c6d6634_SeqId_44_] to archive 2023-03-07 10:54:02,877 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:54:02,879 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/ab0bd0d0583445999e254eb0f8781f23 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/ab0bd0d0583445999e254eb0f8781f23 2023-03-07 10:54:02,882 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/1f196730e73440ebb6c03642ce6ae809 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/1f196730e73440ebb6c03642ce6ae809 2023-03-07 10:54:02,883 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/03852f41dc2c418885ab846d1d6b7ede to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/03852f41dc2c418885ab846d1d6b7ede 2023-03-07 10:54:02,883 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/474059ff0d5b4c57aad73b5d46681d23 first=Optional[r1] last=Optional[r4] 2023-03-07 10:54:02,884 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/474059ff0d5b4c57aad73b5d46681d23}] 2023-03-07 10:54:02,885 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/a28f471173c043078fa5a3ee73c90fc9 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/a28f471173c043078fa5a3ee73c90fc9 2023-03-07 10:54:02,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/474059ff0d5b4c57aad73b5d46681d23 for inclusion in 40137ae7c4e46565e6468a174a44ce08/family1 2023-03-07 10:54:02,886 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/bd0b62db30c347f1850b5279e9529b92 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/bd0b62db30c347f1850b5279e9529b92 2023-03-07 10:54:02,888 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/9f88afbfdd87480f946b311bcd62e123 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/9f88afbfdd87480f946b311bcd62e123 2023-03-07 10:54:02,889 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/91564073bbb5442fbafc9052f3ebefca to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/91564073bbb5442fbafc9052f3ebefca 2023-03-07 10:54:02,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-03-07 10:54:02,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(777): Region bounds: first= last= 2023-03-07 10:54:02,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for 40137ae7c4e46565e6468a174a44ce08: 2023-03-07 10:54:02,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/474059ff0d5b4c57aad73b5d46681d23 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__d969ao1k557h3bot926irgjk0delepapkr19cnltqh430199pa38k6odsm9mea05/family1/474059ff0d5b4c57aad73b5d46681d23 2023-03-07 10:54:02,890 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/29c9dd3f251d438289618400a5148c74 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/29c9dd3f251d438289618400a5148c74 2023-03-07 10:54:02,893 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/ee5d72f1f4c14fc2be1f3e1bfe49c788 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/ee5d72f1f4c14fc2be1f3e1bfe49c788 2023-03-07 10:54:02,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__d969ao1k557h3bot926irgjk0delepapkr19cnltqh430199pa38k6odsm9mea05/family1/474059ff0d5b4c57aad73b5d46681d23 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/7b2d1c5a17374c9ba0ad5e1d69f8be9f_SeqId_47_ 2023-03-07 10:54:02,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__d969ao1k557h3bot926irgjk0delepapkr19cnltqh430199pa38k6odsm9mea05/family1/474059ff0d5b4c57aad73b5d46681d23 into 40137ae7c4e46565e6468a174a44ce08/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/7b2d1c5a17374c9ba0ad5e1d69f8be9f_SeqId_47_ - updating store file list. 2023-03-07 10:54:02,894 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/e401bf06f2a84a3ca8db40be3c6d6634_SeqId_44_ to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/e401bf06f2a84a3ca8db40be3c6d6634_SeqId_44_ 2023-03-07 10:54:02,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/7b2d1c5a17374c9ba0ad5e1d69f8be9f_SeqId_47_ into 40137ae7c4e46565e6468a174a44ce08/family1 2023-03-07 10:54:02,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__d969ao1k557h3bot926irgjk0delepapkr19cnltqh430199pa38k6odsm9mea05/family1/474059ff0d5b4c57aad73b5d46681d23 into 40137ae7c4e46565e6468a174a44ce08/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/7b2d1c5a17374c9ba0ad5e1d69f8be9f_SeqId_47_) 2023-03-07 10:54:02,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__d969ao1k557h3bot926irgjk0delepapkr19cnltqh430199pa38k6odsm9mea05/family1/474059ff0d5b4c57aad73b5d46681d23 2023-03-07 10:54:02,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-07 10:54:02,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-07 10:54:02,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(1912): 40137ae7c4e46565e6468a174a44ce08/family1 is initiating minor compaction (all files) 2023-03-07 10:54:02,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@769c7e07; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:54:02,901 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 40137ae7c4e46565e6468a174a44ce08/family1 in testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:54:02,901 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/8b17e16efdc64b10811db2ee17e04daa, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/1dcd992fac8f47059727ffc023b1dc8c, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/7b2d1c5a17374c9ba0ad5e1d69f8be9f_SeqId_47_] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/.tmp, totalSize=178.1 K 2023-03-07 10:54:02,901 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 8b17e16efdc64b10811db2ee17e04daa, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878838856 2023-03-07 10:54:02,902 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 1dcd992fac8f47059727ffc023b1dc8c, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621238856 2023-03-07 10:54:02,902 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 7b2d1c5a17374c9ba0ad5e1d69f8be9f_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965238856 2023-03-07 10:54:02,903 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-07 10:54:02,903 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:54:02,905 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512014df2900f349746c6b21381267fc0fa3f to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512014df2900f349746c6b21381267fc0fa3f 2023-03-07 10:54:02,907 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205c18591de0fb541019a0ff02c3bb1e21f to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205c18591de0fb541019a0ff02c3bb1e21f 2023-03-07 10:54:02,908 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122830cb922d04d744bfa0e0595f1793e90c to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122830cb922d04d744bfa0e0595f1793e90c 2023-03-07 10:54:02,909 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512313737543938314cbe9fe96bfab870df86 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512313737543938314cbe9fe96bfab870df86 2023-03-07 10:54:02,909 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-03-07 10:54:02,909 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-03-07 10:54:02,910 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-07 10:54:02,910 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-07 10:54:02,921 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] throttle.PressureAwareThroughputController(145): 40137ae7c4e46565e6468a174a44ce08#family1#compaction#23 average throughput is 17.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:54:03,745 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/.tmp/family1/965d6751ac984431b14d69af346d5f92 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/965d6751ac984431b14d69af346d5f92 2023-03-07 10:54:03,752 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 40137ae7c4e46565e6468a174a44ce08/family1 of 40137ae7c4e46565e6468a174a44ce08 into 965d6751ac984431b14d69af346d5f92(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-07 10:54:03,752 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 40137ae7c4e46565e6468a174a44ce08: 2023-03-07 10:54:03,752 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1678186442900; duration=0sec 2023-03-07 10:54:03,752 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:54:03,753 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113038d01e04edf4455db4b61c199bc63538 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113038d01e04edf4455db4b61c199bc63538 2023-03-07 10:54:03,754 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-07 10:54:03,769 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/8b17e16efdc64b10811db2ee17e04daa, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/1dcd992fac8f47059727ffc023b1dc8c, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/7b2d1c5a17374c9ba0ad5e1d69f8be9f_SeqId_47_] to archive 2023-03-07 10:54:03,770 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:54:03,772 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/8b17e16efdc64b10811db2ee17e04daa to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/8b17e16efdc64b10811db2ee17e04daa 2023-03-07 10:54:03,774 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/1dcd992fac8f47059727ffc023b1dc8c to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/1dcd992fac8f47059727ffc023b1dc8c 2023-03-07 10:54:03,775 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/7b2d1c5a17374c9ba0ad5e1d69f8be9f_SeqId_47_ to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/7b2d1c5a17374c9ba0ad5e1d69f8be9f_SeqId_47_ 2023-03-07 10:54:03,781 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/96fce213b0044f94bc6b8af0d0ab5714 first=Optional[r00] last=Optional[r8] 2023-03-07 10:54:03,781 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/96fce213b0044f94bc6b8af0d0ab5714}] 2023-03-07 10:54:03,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/96fce213b0044f94bc6b8af0d0ab5714 for inclusion in 40137ae7c4e46565e6468a174a44ce08/family1 2023-03-07 10:54:03,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-03-07 10:54:03,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(777): Region bounds: first= last= 2023-03-07 10:54:03,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for 40137ae7c4e46565e6468a174a44ce08: 2023-03-07 10:54:03,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/96fce213b0044f94bc6b8af0d0ab5714 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__bm8gv2qrrg4pag2r4pvqu434qt1elpl297rdg5o2n7ncnols3peti8k1r2fbj2v1/family1/96fce213b0044f94bc6b8af0d0ab5714 2023-03-07 10:54:03,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__bm8gv2qrrg4pag2r4pvqu434qt1elpl297rdg5o2n7ncnols3peti8k1r2fbj2v1/family1/96fce213b0044f94bc6b8af0d0ab5714 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/b422acde766a4b94bea8f036d1e13399_SeqId_50_ 2023-03-07 10:54:03,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__bm8gv2qrrg4pag2r4pvqu434qt1elpl297rdg5o2n7ncnols3peti8k1r2fbj2v1/family1/96fce213b0044f94bc6b8af0d0ab5714 into 40137ae7c4e46565e6468a174a44ce08/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/b422acde766a4b94bea8f036d1e13399_SeqId_50_ - updating store file list. 2023-03-07 10:54:03,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/b422acde766a4b94bea8f036d1e13399_SeqId_50_ into 40137ae7c4e46565e6468a174a44ce08/family1 2023-03-07 10:54:03,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__bm8gv2qrrg4pag2r4pvqu434qt1elpl297rdg5o2n7ncnols3peti8k1r2fbj2v1/family1/96fce213b0044f94bc6b8af0d0ab5714 into 40137ae7c4e46565e6468a174a44ce08/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/family1/b422acde766a4b94bea8f036d1e13399_SeqId_50_) 2023-03-07 10:54:03,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__bm8gv2qrrg4pag2r4pvqu434qt1elpl297rdg5o2n7ncnols3peti8k1r2fbj2v1/family1/96fce213b0044f94bc6b8af0d0ab5714 2023-03-07 10:54:03,797 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-07 10:54:03,798 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:54:03,799 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511202f351c7ef9dd422fa0b29e0024a4ee91 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511202f351c7ef9dd422fa0b29e0024a4ee91 2023-03-07 10:54:03,800 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112807d24cf09c634e19bec540d00d7b13f3 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112807d24cf09c634e19bec540d00d7b13f3 2023-03-07 10:54:03,801 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511300a815b2bd52b4f5c9f0e41430cda23a3 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511300a815b2bd52b4f5c9f0e41430cda23a3 2023-03-07 10:54:03,801 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-03-07 10:54:03,801 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-07 10:54:03,802 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-07 10:54:03,802 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-07 10:54:03,802 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-07 10:54:03,802 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-07 10:54:03,802 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:54:03,803 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-07 10:54:03,805 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.7090 sec 2023-03-07 10:54:03,903 INFO [Listener at localhost/42383] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=255 (was 250) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-49182198_15 at /127.0.0.1:48908 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:48892 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:48960 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cb0d4cc-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:48970 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:48986 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:48916 [Waiting for operation #17] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:48988 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:48992 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56055@0x4b654dd9-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x3cb0d4cc-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cb0d4cc-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56055@0x4b654dd9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1994893333.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cb0d4cc-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:48880 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:48954 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:49020 [Waiting for operation #17] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:48952 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cb0d4cc-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:38382 [Waiting for operation #35] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-49182198_15 at /127.0.0.1:38348 [Waiting for operation #27] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56055@0x4b654dd9-SendThread(127.0.0.1:56055) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:49076 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1635711942_15 at /127.0.0.1:48994 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cb0d4cc-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cb0d4cc-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=607 (was 593) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=305 (was 315), ProcessCount=171 (was 171), AvailableMemoryMB=10044 (was 9446) - AvailableMemoryMB LEAK? - 2023-03-07 10:54:03,916 INFO [Listener at localhost/42383] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=255, OpenFileDescriptor=607, MaxFileDescriptor=60000, SystemLoadAverage=305, ProcessCount=171, AvailableMemoryMB=10043 2023-03-07 10:54:03,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-07 10:54:03,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:03,922 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-07 10:54:03,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-03-07 10:54:03,923 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-07 10:54:03,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-07 10:54:03,924 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e 2023-03-07 10:54:03,925 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e empty. 2023-03-07 10:54:03,926 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e 2023-03-07 10:54:03,926 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-03-07 10:54:03,935 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-07 10:54:03,937 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8036776dda3d2e3fb58ead3edb012c6e, NAME => 'testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp 2023-03-07 10:54:03,944 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:54:03,944 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 8036776dda3d2e3fb58ead3edb012c6e, disabling compactions & flushes 2023-03-07 10:54:03,944 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:03,944 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:03,944 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. after waiting 0 ms 2023-03-07 10:54:03,944 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:03,944 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:03,944 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 8036776dda3d2e3fb58ead3edb012c6e: 2023-03-07 10:54:03,947 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-07 10:54:03,948 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678186443948"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186443948"}]},"ts":"1678186443948"} 2023-03-07 10:54:03,950 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-07 10:54:03,951 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-07 10:54:03,951 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186443951"}]},"ts":"1678186443951"} 2023-03-07 10:54:03,952 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-03-07 10:54:03,959 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=8036776dda3d2e3fb58ead3edb012c6e, ASSIGN}] 2023-03-07 10:54:03,961 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=8036776dda3d2e3fb58ead3edb012c6e, ASSIGN 2023-03-07 10:54:03,962 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=8036776dda3d2e3fb58ead3edb012c6e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39673,1678186416064; forceNewPlan=false, retain=false 2023-03-07 10:54:04,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-07 10:54:04,113 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=8036776dda3d2e3fb58ead3edb012c6e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:04,114 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678186444113"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186444113"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186444113"}]},"ts":"1678186444113"} 2023-03-07 10:54:04,115 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 8036776dda3d2e3fb58ead3edb012c6e, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:54:04,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-07 10:54:04,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:04,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8036776dda3d2e3fb58ead3edb012c6e, NAME => 'testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e.', STARTKEY => '', ENDKEY => ''} 2023-03-07 10:54:04,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 8036776dda3d2e3fb58ead3edb012c6e 2023-03-07 10:54:04,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:54:04,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8036776dda3d2e3fb58ead3edb012c6e 2023-03-07 10:54:04,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8036776dda3d2e3fb58ead3edb012c6e 2023-03-07 10:54:04,273 INFO [StoreOpener-8036776dda3d2e3fb58ead3edb012c6e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8036776dda3d2e3fb58ead3edb012c6e 2023-03-07 10:54:04,274 DEBUG [StoreOpener-8036776dda3d2e3fb58ead3edb012c6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1 2023-03-07 10:54:04,274 DEBUG [StoreOpener-8036776dda3d2e3fb58ead3edb012c6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1 2023-03-07 10:54:04,275 INFO [StoreOpener-8036776dda3d2e3fb58ead3edb012c6e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8036776dda3d2e3fb58ead3edb012c6e columnFamilyName family1 2023-03-07 10:54:04,276 INFO [StoreOpener-8036776dda3d2e3fb58ead3edb012c6e-1] regionserver.HStore(310): Store=8036776dda3d2e3fb58ead3edb012c6e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:54:04,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e 2023-03-07 10:54:04,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e 2023-03-07 10:54:04,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8036776dda3d2e3fb58ead3edb012c6e 2023-03-07 10:54:04,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-07 10:54:04,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8036776dda3d2e3fb58ead3edb012c6e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62158769, jitterRate=-0.07376216351985931}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-07 10:54:04,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8036776dda3d2e3fb58ead3edb012c6e: 2023-03-07 10:54:04,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e., pid=25, masterSystemTime=1678186444267 2023-03-07 10:54:04,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:04,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:04,285 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=8036776dda3d2e3fb58ead3edb012c6e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:04,285 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678186444285"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186444285"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186444285"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186444285"}]},"ts":"1678186444285"} 2023-03-07 10:54:04,288 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-03-07 10:54:04,288 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 8036776dda3d2e3fb58ead3edb012c6e, server=jenkins-hbase4.apache.org,39673,1678186416064 in 172 msec 2023-03-07 10:54:04,290 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-03-07 10:54:04,290 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=8036776dda3d2e3fb58ead3edb012c6e, ASSIGN in 329 msec 2023-03-07 10:54:04,291 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-07 10:54:04,291 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186444291"}]},"ts":"1678186444291"} 2023-03-07 10:54:04,292 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-03-07 10:54:04,295 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-07 10:54:04,296 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 376 msec 2023-03-07 10:54:04,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-07 10:54:04,527 INFO [Listener at localhost/42383] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-03-07 10:54:04,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:04,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:04,549 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-07 10:54:04,549 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:04,549 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-07 10:54:04,549 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-07 10:54:04,549 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:04,549 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:04,551 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:04,551 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:04,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:04,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:04,551 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:04,551 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:04,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:04,552 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:04,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:04,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:04,552 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:04,552 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:04,552 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-07 10:54:04,552 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:04,552 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-07 10:54:04,552 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:04,552 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:04,553 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:04,553 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. started... 2023-03-07 10:54:04,553 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8036776dda3d2e3fb58ead3edb012c6e 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-07 10:54:04,973 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130cf7e6427abd341cfbecaed5e2160ae02 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130cf7e6427abd341cfbecaed5e2160ae02 2023-03-07 10:54:05,378 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/.tmp/family1/08a35b46cb3b40f8881489aa807e614d 2023-03-07 10:54:05,383 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/.tmp/family1/08a35b46cb3b40f8881489aa807e614d as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/08a35b46cb3b40f8881489aa807e614d 2023-03-07 10:54:05,388 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/08a35b46cb3b40f8881489aa807e614d, entries=1000, sequenceid=5, filesize=165.1 K 2023-03-07 10:54:05,389 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 8036776dda3d2e3fb58ead3edb012c6e in 836ms, sequenceid=5, compaction requested=false 2023-03-07 10:54:05,389 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-03-07 10:54:05,389 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8036776dda3d2e3fb58ead3edb012c6e: 2023-03-07 10:54:05,389 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:05,389 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:05,389 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:05,389 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:05,389 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-07 10:54:05,390 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-07 10:54:05,391 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:05,391 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:05,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:05,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:05,391 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,391 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:05,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:05,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:05,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:05,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:05,393 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-07 10:54:05,393 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63efaf5b[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:05,393 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-07 10:54:05,393 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,395 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,395 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-07 10:54:05,395 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-07 10:54:05,395 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:05,395 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:05,395 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:05,396 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-07 10:54:05,396 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:05,397 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:05,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:05,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:05,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:05,397 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-07 10:54:05,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:05,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:05,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:05,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:05,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:05,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:05,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:54:05,399 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-07 10:54:05,399 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:05,399 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:05,399 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,399 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:05,400 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,400 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:05,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,400 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:05,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:05,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:05,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:05,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:05,401 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:05,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:05,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,402 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:05,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:05,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:05,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:05,404 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:05,404 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:05,404 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:05,404 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,404 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-07 10:54:05,404 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:05,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:05,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-07 10:54:05,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:05,404 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:05,404 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:05,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:05,405 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:05,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:05,405 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,405 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:05,405 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,405 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,505 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:05,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:05,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:05,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:05,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,512 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-07 10:54:05,512 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:05,512 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-07 10:54:05,512 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-07 10:54:05,513 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,513 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,515 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:05,515 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:05,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:05,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:05,515 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:05,515 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:05,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:05,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,516 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,516 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-07 10:54:05,517 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:05,517 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-07 10:54:05,517 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:05,517 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-07 10:54:05,517 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:05,517 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:05,517 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:05,517 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. started... 2023-03-07 10:54:05,517 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8036776dda3d2e3fb58ead3edb012c6e 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-07 10:54:05,930 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511282bae8211975c4c6a9884b73df95c3fbf to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511282bae8211975c4c6a9884b73df95c3fbf 2023-03-07 10:54:06,336 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/.tmp/family1/2a55e197b4d44f57ae95368d3f97a9dd 2023-03-07 10:54:06,341 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/.tmp/family1/2a55e197b4d44f57ae95368d3f97a9dd as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/2a55e197b4d44f57ae95368d3f97a9dd 2023-03-07 10:54:06,346 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/2a55e197b4d44f57ae95368d3f97a9dd, entries=1, sequenceid=9, filesize=5.0 K 2023-03-07 10:54:06,347 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 8036776dda3d2e3fb58ead3edb012c6e in 830ms, sequenceid=9, compaction requested=false 2023-03-07 10:54:06,347 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8036776dda3d2e3fb58ead3edb012c6e: 2023-03-07 10:54:06,347 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:06,347 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:06,348 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:06,348 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:06,348 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-07 10:54:06,348 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-07 10:54:06,349 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,349 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:06,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:06,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:06,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:06,350 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,350 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:06,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:06,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:06,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:06,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:06,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-07 10:54:06,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@195701a[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:06,351 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-07 10:54:06,352 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,353 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,353 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-07 10:54:06,353 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-07 10:54:06,353 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:06,353 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:06,353 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:06,355 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:06,355 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-07 10:54:06,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:06,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:06,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:06,355 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:06,355 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-07 10:54:06,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:06,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:06,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:06,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:06,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:06,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:06,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:54:06,358 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-07 10:54:06,358 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:06,358 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:06,358 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,358 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:06,360 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,360 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,360 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:06,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:06,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:06,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,361 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:06,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:06,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:06,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:06,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:06,362 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:06,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:06,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:06,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:06,364 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:06,364 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:06,364 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-07 10:54:06,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:06,364 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:06,364 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:06,364 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:06,364 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-07 10:54:06,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:06,364 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:06,364 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:06,365 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:06,365 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,365 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,365 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:06,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:06,465 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:06,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:06,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:06,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:06,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,472 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-07 10:54:06,472 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:06,472 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-07 10:54:06,472 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-07 10:54:06,472 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,473 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,474 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:06,474 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:06,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:06,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:06,474 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:06,474 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:06,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,475 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:06,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,475 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,475 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-07 10:54:06,475 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:06,475 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-07 10:54:06,475 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:06,475 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-07 10:54:06,476 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:06,476 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:06,476 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:06,476 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. started... 2023-03-07 10:54:06,476 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8036776dda3d2e3fb58ead3edb012c6e 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:06,889 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512011d1ce345f45146f0af4068cb017e44fe to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512011d1ce345f45146f0af4068cb017e44fe 2023-03-07 10:54:07,295 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/.tmp/family1/2af91e6d39764bbd922d44132d4c1f46 2023-03-07 10:54:07,300 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/.tmp/family1/2af91e6d39764bbd922d44132d4c1f46 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/2af91e6d39764bbd922d44132d4c1f46 2023-03-07 10:54:07,305 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/2af91e6d39764bbd922d44132d4c1f46, entries=1, sequenceid=13, filesize=4.9 K 2023-03-07 10:54:07,306 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8036776dda3d2e3fb58ead3edb012c6e in 830ms, sequenceid=13, compaction requested=true 2023-03-07 10:54:07,306 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8036776dda3d2e3fb58ead3edb012c6e: 2023-03-07 10:54:07,306 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:07,306 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:07,306 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:07,306 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:07,307 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-07 10:54:07,307 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-07 10:54:07,308 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:07,308 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:07,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:07,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:07,309 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,309 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:07,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:07,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:07,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:07,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:07,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-07 10:54:07,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16d5150d[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:07,310 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-07 10:54:07,310 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,312 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,313 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-07 10:54:07,313 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-07 10:54:07,313 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:07,313 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:07,313 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:07,314 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-07 10:54:07,314 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:07,314 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:07,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:07,314 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-07 10:54:07,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:07,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:07,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:07,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:07,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:07,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:07,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:07,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:07,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:54:07,316 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-07 10:54:07,316 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:07,316 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:07,316 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,316 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:07,318 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,318 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,318 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:07,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:07,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:07,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,318 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:07,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:07,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:07,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:07,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:07,319 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:07,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:07,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:07,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:07,325 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:07,325 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,325 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:07,325 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:07,325 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:07,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-07 10:54:07,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:07,325 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:07,325 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-07 10:54:07,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:07,325 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:07,325 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,325 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:07,325 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:07,326 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:07,326 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:07,426 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:07,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:07,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:07,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:07,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,433 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-07 10:54:07,433 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:07,433 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-07 10:54:07,434 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-07 10:54:07,434 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,434 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,436 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:07,436 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:07,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:07,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:07,436 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:07,436 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:07,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,437 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:07,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,437 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,437 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-07 10:54:07,437 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:07,437 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-07 10:54:07,437 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:07,437 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-07 10:54:07,437 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:07,437 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:07,437 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:07,437 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. started... 2023-03-07 10:54:07,438 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8036776dda3d2e3fb58ead3edb012c6e 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:07,851 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120541e9a672d3484d2194ebcc20379f2b7d to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120541e9a672d3484d2194ebcc20379f2b7d 2023-03-07 10:54:08,257 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/.tmp/family1/25a327df1d054791a4fe291293d69529 2023-03-07 10:54:08,262 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/.tmp/family1/25a327df1d054791a4fe291293d69529 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/25a327df1d054791a4fe291293d69529 2023-03-07 10:54:08,266 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/25a327df1d054791a4fe291293d69529, entries=1, sequenceid=17, filesize=4.9 K 2023-03-07 10:54:08,267 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8036776dda3d2e3fb58ead3edb012c6e in 829ms, sequenceid=17, compaction requested=true 2023-03-07 10:54:08,267 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8036776dda3d2e3fb58ead3edb012c6e: 2023-03-07 10:54:08,267 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:08,267 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:08,267 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:08,267 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:08,267 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-07 10:54:08,267 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-07 10:54:08,269 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:08,269 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:08,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:08,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:08,269 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,269 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:08,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:08,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:08,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:08,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:08,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-07 10:54:08,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@415ce734[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:08,271 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-07 10:54:08,271 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,272 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,272 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-07 10:54:08,272 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-07 10:54:08,272 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:08,272 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:08,272 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:08,275 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:08,275 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-07 10:54:08,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:08,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:08,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:08,275 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:08,275 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-07 10:54:08,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:08,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:08,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:08,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:08,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:08,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:08,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:54:08,277 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-07 10:54:08,277 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:08,277 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:08,277 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,277 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:08,278 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,278 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:08,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:08,278 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:08,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:08,279 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:08,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:08,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:08,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:08,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,280 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:08,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:08,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:08,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:08,282 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:08,282 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:08,282 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:08,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-07 10:54:08,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:08,282 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:08,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:08,282 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:08,282 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,282 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:08,282 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,282 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,282 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:08,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:08,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:08,282 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:08,282 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,383 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:08,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:08,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:08,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:08,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,390 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-07 10:54:08,390 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:08,390 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-07 10:54:08,390 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-07 10:54:08,390 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,390 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,392 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:08,392 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:08,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:08,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:08,392 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:08,392 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:08,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,392 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:08,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,393 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,393 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-07 10:54:08,393 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:08,393 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-07 10:54:08,393 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:08,393 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-07 10:54:08,393 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:08,393 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:08,393 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:08,393 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. started... 2023-03-07 10:54:08,394 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8036776dda3d2e3fb58ead3edb012c6e 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:08,808 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512288d1fc1dcf0114ec8acf90f32141a18ab to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512288d1fc1dcf0114ec8acf90f32141a18ab 2023-03-07 10:54:09,214 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/.tmp/family1/7effaadb7f8248e78efe83da2c49f781 2023-03-07 10:54:09,219 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/.tmp/family1/7effaadb7f8248e78efe83da2c49f781 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/7effaadb7f8248e78efe83da2c49f781 2023-03-07 10:54:09,223 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/7effaadb7f8248e78efe83da2c49f781, entries=1, sequenceid=21, filesize=4.9 K 2023-03-07 10:54:09,224 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8036776dda3d2e3fb58ead3edb012c6e in 830ms, sequenceid=21, compaction requested=true 2023-03-07 10:54:09,224 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8036776dda3d2e3fb58ead3edb012c6e: 2023-03-07 10:54:09,224 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:09,224 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:09,225 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:09,225 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:09,225 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-07 10:54:09,225 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-07 10:54:09,227 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:09,227 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:09,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:09,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:09,227 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,227 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:09,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:09,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:09,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:09,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:09,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-07 10:54:09,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f570d33[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:09,229 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-07 10:54:09,229 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,230 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,230 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-07 10:54:09,230 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-07 10:54:09,230 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:09,230 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:09,230 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:09,232 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:09,232 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-07 10:54:09,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:09,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:09,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:09,232 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:09,232 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-07 10:54:09,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:09,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:09,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:09,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:09,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:09,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:09,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:54:09,234 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-07 10:54:09,234 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:09,234 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:09,234 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,234 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:09,235 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,235 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:09,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:09,235 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:09,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:09,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:09,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:09,236 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:09,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:09,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:09,237 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:09,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:09,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:09,240 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:09,240 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:09,240 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,240 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:09,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:09,240 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:09,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:09,240 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-07 10:54:09,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:09,241 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:09,241 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,241 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,241 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:09,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:09,241 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:09,241 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:09,341 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:09,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:09,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:09,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:09,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,348 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-07 10:54:09,348 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:09,348 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-07 10:54:09,348 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-07 10:54:09,349 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,349 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,350 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:09,350 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:09,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:09,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:09,350 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:09,350 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:09,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,351 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:09,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,351 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,352 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-07 10:54:09,352 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:09,352 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-07 10:54:09,352 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:09,352 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-07 10:54:09,352 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:09,352 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:09,352 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:09,352 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. started... 2023-03-07 10:54:09,352 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8036776dda3d2e3fb58ead3edb012c6e 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:09,766 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231c614773eb11846d19450a3e6b0338bd1 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231c614773eb11846d19450a3e6b0338bd1 2023-03-07 10:54:09,804 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-07 10:54:10,172 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/.tmp/family1/97e9dcb684e143c9bc2f704036a51755 2023-03-07 10:54:10,177 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/.tmp/family1/97e9dcb684e143c9bc2f704036a51755 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/97e9dcb684e143c9bc2f704036a51755 2023-03-07 10:54:10,182 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/97e9dcb684e143c9bc2f704036a51755, entries=1, sequenceid=25, filesize=4.9 K 2023-03-07 10:54:10,183 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8036776dda3d2e3fb58ead3edb012c6e in 831ms, sequenceid=25, compaction requested=true 2023-03-07 10:54:10,183 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8036776dda3d2e3fb58ead3edb012c6e: 2023-03-07 10:54:10,183 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:10,183 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:10,183 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:10,183 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:10,183 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-07 10:54:10,183 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-07 10:54:10,185 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:10,185 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:10,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:10,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:10,185 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:10,185 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:10,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:10,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:10,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:10,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-07 10:54:10,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75e8a363[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:10,187 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-07 10:54:10,187 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,188 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,188 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-07 10:54:10,188 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:10,188 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:10,188 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-07 10:54:10,188 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:10,190 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-07 10:54:10,190 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:10,190 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:10,191 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-07 10:54:10,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:10,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:10,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:10,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:10,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:10,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:10,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:10,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:10,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:10,193 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:54:10,193 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-07 10:54:10,193 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:10,193 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:10,193 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,193 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:10,197 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,197 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:10,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:10,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,197 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:10,197 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:10,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:10,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:10,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:10,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:10,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,198 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:10,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:10,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:10,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:10,201 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:10,201 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,201 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:10,201 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:10,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-07 10:54:10,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:10,201 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:10,201 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:10,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:10,201 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:10,201 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:10,201 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,201 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:10,201 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:10,201 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:10,301 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:10,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:10,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:10,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:10,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,308 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-07 10:54:10,308 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:10,309 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-07 10:54:10,309 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-07 10:54:10,309 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,309 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,312 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:10,312 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:10,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:10,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:10,312 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:10,312 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:10,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,313 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:10,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,313 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,313 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-07 10:54:10,313 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:10,313 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-07 10:54:10,313 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:10,313 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-07 10:54:10,314 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:10,314 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:10,314 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:10,314 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. started... 2023-03-07 10:54:10,314 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8036776dda3d2e3fb58ead3edb012c6e 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:10,729 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101dcfd459d2fae44d28d1972046f4be9d7 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101dcfd459d2fae44d28d1972046f4be9d7 2023-03-07 10:54:11,135 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/.tmp/family1/836fc4e774ee43adb4f326906bb524fa 2023-03-07 10:54:11,140 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/.tmp/family1/836fc4e774ee43adb4f326906bb524fa as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/836fc4e774ee43adb4f326906bb524fa 2023-03-07 10:54:11,144 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/836fc4e774ee43adb4f326906bb524fa, entries=1, sequenceid=29, filesize=4.9 K 2023-03-07 10:54:11,145 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8036776dda3d2e3fb58ead3edb012c6e in 831ms, sequenceid=29, compaction requested=true 2023-03-07 10:54:11,145 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8036776dda3d2e3fb58ead3edb012c6e: 2023-03-07 10:54:11,145 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:11,145 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:11,145 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:11,145 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:11,145 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-07 10:54:11,145 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-07 10:54:11,147 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,147 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:11,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:11,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:11,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:11,147 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:11,147 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:11,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:11,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:11,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:11,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-07 10:54:11,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b2badae[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:11,149 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-07 10:54:11,149 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,150 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,150 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-07 10:54:11,150 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:11,150 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:11,150 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-07 10:54:11,150 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:11,151 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-07 10:54:11,151 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:11,152 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:11,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:11,152 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-07 10:54:11,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:11,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:11,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:11,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:11,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:11,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:11,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:11,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:11,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:54:11,154 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-07 10:54:11,154 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:11,154 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:11,154 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,154 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:11,156 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,156 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:11,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:11,156 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:11,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:11,157 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:11,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:11,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:11,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:11,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,158 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:11,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:11,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:11,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:11,160 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:11,160 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:11,160 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,160 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:11,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:11,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-07 10:54:11,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:11,160 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,160 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:11,160 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-07 10:54:11,160 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:11,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:11,160 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,160 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:11,161 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:11,161 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:11,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:11,161 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,261 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:11,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:11,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:11,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:11,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,267 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-07 10:54:11,267 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:11,267 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-07 10:54:11,267 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-07 10:54:11,268 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,268 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,269 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:11,269 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:11,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:11,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:11,269 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:11,269 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:11,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,270 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:11,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,270 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,270 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-07 10:54:11,270 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:11,270 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-07 10:54:11,270 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:11,270 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-07 10:54:11,271 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:11,271 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:11,271 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:11,271 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. started... 2023-03-07 10:54:11,271 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8036776dda3d2e3fb58ead3edb012c6e 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:11,684 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038f03933539274ef7a391d2219391ae91 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601038f03933539274ef7a391d2219391ae91 2023-03-07 10:54:12,089 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/.tmp/family1/d519bb71422e49bf852005018da75714 2023-03-07 10:54:12,095 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/.tmp/family1/d519bb71422e49bf852005018da75714 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/d519bb71422e49bf852005018da75714 2023-03-07 10:54:12,099 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/d519bb71422e49bf852005018da75714, entries=1, sequenceid=33, filesize=4.9 K 2023-03-07 10:54:12,100 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8036776dda3d2e3fb58ead3edb012c6e in 829ms, sequenceid=33, compaction requested=true 2023-03-07 10:54:12,100 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8036776dda3d2e3fb58ead3edb012c6e: 2023-03-07 10:54:12,100 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:12,100 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:12,100 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:12,100 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:12,101 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-07 10:54:12,101 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-07 10:54:12,102 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:12,102 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:12,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:12,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:12,103 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,103 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:12,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:12,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:12,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:12,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:12,104 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-07 10:54:12,104 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6de896b8[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:12,104 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-07 10:54:12,104 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,106 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,106 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-07 10:54:12,107 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-07 10:54:12,107 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:12,107 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:12,107 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:12,108 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-07 10:54:12,108 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:12,108 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:12,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:12,108 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-07 10:54:12,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:12,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:12,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:12,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:12,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:12,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:12,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:12,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:12,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:54:12,110 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-07 10:54:12,110 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:12,110 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:12,110 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,110 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:12,112 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,112 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:12,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:12,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,112 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:12,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:12,113 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:12,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:12,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:12,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:12,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,114 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:12,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:12,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:12,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:12,116 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:12,116 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,116 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:12,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-07 10:54:12,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:12,116 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:12,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:12,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-07 10:54:12,116 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:12,116 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,116 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:12,117 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:12,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:12,116 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:12,117 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,117 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,117 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:12,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:12,217 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:12,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:12,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:12,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:12,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,223 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-07 10:54:12,223 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:12,223 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-07 10:54:12,223 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-07 10:54:12,224 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,224 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,226 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:12,226 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:12,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:12,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:12,226 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:12,226 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:12,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,227 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:12,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,227 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,227 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-07 10:54:12,227 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:12,227 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-07 10:54:12,227 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:12,227 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-07 10:54:12,227 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:12,227 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:12,227 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:12,228 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. started... 2023-03-07 10:54:12,228 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8036776dda3d2e3fb58ead3edb012c6e 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:12,641 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509076fde959bdbae45679b1677399d9255c0 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201509076fde959bdbae45679b1677399d9255c0 2023-03-07 10:54:13,046 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/.tmp/family1/f3aabd30440d4938b6c0d0437533e891 2023-03-07 10:54:13,052 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/.tmp/family1/f3aabd30440d4938b6c0d0437533e891 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/f3aabd30440d4938b6c0d0437533e891 2023-03-07 10:54:13,057 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/f3aabd30440d4938b6c0d0437533e891, entries=1, sequenceid=37, filesize=4.9 K 2023-03-07 10:54:13,058 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8036776dda3d2e3fb58ead3edb012c6e in 830ms, sequenceid=37, compaction requested=true 2023-03-07 10:54:13,058 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8036776dda3d2e3fb58ead3edb012c6e: 2023-03-07 10:54:13,058 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:13,058 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:13,058 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:13,058 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:13,058 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-07 10:54:13,058 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-07 10:54:13,060 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,060 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:13,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:13,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:13,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:13,060 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,060 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:13,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:13,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:13,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:13,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:13,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-07 10:54:13,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ab130a3[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:13,062 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-07 10:54:13,062 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,066 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,066 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-07 10:54:13,066 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-07 10:54:13,066 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:13,066 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:13,066 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:13,069 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:13,069 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-07 10:54:13,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:13,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:13,069 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:13,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:13,069 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-07 10:54:13,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:13,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:13,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:13,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:13,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:13,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:13,071 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:54:13,071 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-07 10:54:13,072 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:13,072 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:13,072 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,072 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:13,073 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,073 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:13,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,073 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:13,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:13,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:13,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:13,074 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:13,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:13,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:13,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,075 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:13,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:13,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:13,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:13,077 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:13,077 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:13,077 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:13,077 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-07 10:54:13,077 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:13,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:13,077 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:13,077 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:13,077 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-07 10:54:13,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:13,077 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:13,077 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:13,077 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,078 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,078 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:13,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:13,178 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:13,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:13,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:13,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:13,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,184 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-07 10:54:13,184 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:13,184 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-07 10:54:13,184 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-07 10:54:13,185 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,185 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,186 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:13,186 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:13,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:13,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:13,187 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:13,187 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:13,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,187 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:13,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,188 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,188 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-07 10:54:13,188 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:13,188 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-07 10:54:13,188 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:13,188 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-07 10:54:13,188 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:13,188 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:13,188 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:13,188 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. started... 2023-03-07 10:54:13,188 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8036776dda3d2e3fb58ead3edb012c6e 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:13,602 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120685bfd9e7dd94084a077ee078b7efc7a to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120685bfd9e7dd94084a077ee078b7efc7a 2023-03-07 10:54:14,009 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/.tmp/family1/e3d778e5fb4e4bae8c5d75302a37c825 2023-03-07 10:54:14,015 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/.tmp/family1/e3d778e5fb4e4bae8c5d75302a37c825 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/e3d778e5fb4e4bae8c5d75302a37c825 2023-03-07 10:54:14,021 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/e3d778e5fb4e4bae8c5d75302a37c825, entries=1, sequenceid=41, filesize=4.9 K 2023-03-07 10:54:14,022 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8036776dda3d2e3fb58ead3edb012c6e in 834ms, sequenceid=41, compaction requested=true 2023-03-07 10:54:14,022 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8036776dda3d2e3fb58ead3edb012c6e: 2023-03-07 10:54:14,022 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:14,022 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:14,022 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:14,022 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:14,022 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-07 10:54:14,022 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-07 10:54:14,025 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:14,025 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:14,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:14,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:14,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:14,025 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:14,025 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:14,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:14,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:14,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:14,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:14,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:14,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-07 10:54:14,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a72792d[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:14,027 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-07 10:54:14,027 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:14,028 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:14,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:14,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:14,028 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-07 10:54:14,028 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-07 10:54:14,028 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:14,029 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:14,029 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:14,030 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-07 10:54:14,030 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:14,030 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:14,030 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-07 10:54:14,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:14,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:14,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:14,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:14,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:14,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:14,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:14,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:14,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:14,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:14,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:14,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:54:14,033 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-07 10:54:14,033 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:14,033 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:14,033 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:14,033 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:14,034 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:14,035 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:14,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:14,035 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:14,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:14,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:14,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:14,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:14,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:14,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:14,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:14,035 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:14,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:14,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:14,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:14,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:14,036 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:14,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:14,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:14,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:14,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:14,040 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:14,040 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:14,040 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:14,040 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:14,041 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-07 10:54:14,041 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:14,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:14,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-07 10:54:14,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:14,040 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:14,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:14,041 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:14,041 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:14,041 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:14,041 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:14,041 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:14,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:14,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:14,041 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:14,142 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:14,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:14,144 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45579] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-03-07 10:54:14,146 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-07 10:54:14,147 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-07 10:54:14,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:54:14,148 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678187054148 2023-03-07 10:54:14,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-07 10:54:14,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-03-07 10:54:14,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-07 10:54:14,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] zookeeper.ReadOnlyZKClient(139): Connect 0x283f34e5 to 127.0.0.1:56055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-07 10:54:14,157 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1213839a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-07 10:54:14,157 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-07 10:54:14,605 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103320ba07e333d4aeab68eae5bf64ed5a0 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103320ba07e333d4aeab68eae5bf64ed5a0 2023-03-07 10:54:14,606 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-07 10:54:14,621 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-07 10:54:14,622 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48182, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-07 10:54:14,631 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-07 10:54:14,633 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52698, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-07 10:54:14,649 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/335779a3807f4e799913fcfe557dbc80 first=Optional[r3] last=Optional[r6] 2023-03-07 10:54:14,649 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/335779a3807f4e799913fcfe557dbc80}] 2023-03-07 10:54:14,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/335779a3807f4e799913fcfe557dbc80 for inclusion in 8036776dda3d2e3fb58ead3edb012c6e/family1 2023-03-07 10:54:14,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-07 10:54:14,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(777): Region bounds: first= last= 2023-03-07 10:54:14,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for 8036776dda3d2e3fb58ead3edb012c6e: 2023-03-07 10:54:14,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/335779a3807f4e799913fcfe557dbc80 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__hko8cfd3uqegh38fep3vpfk1sb78m991kgicj66kla3ngh3oq1dptl2pdron422/family1/335779a3807f4e799913fcfe557dbc80 2023-03-07 10:54:14,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__hko8cfd3uqegh38fep3vpfk1sb78m991kgicj66kla3ngh3oq1dptl2pdron422/family1/335779a3807f4e799913fcfe557dbc80 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/2a3adf15b10a4915bab19c2642d29311_SeqId_44_ 2023-03-07 10:54:14,704 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-07 10:54:14,704 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1859258b to 127.0.0.1:56055 2023-03-07 10:54:14,704 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-07 10:54:14,705 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-07 10:54:14,706 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b654dd9 to 127.0.0.1:56055 2023-03-07 10:54:14,706 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-07 10:54:14,706 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-07 10:54:14,706 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70134324 to 127.0.0.1:56055 2023-03-07 10:54:14,706 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-07 10:54:14,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__hko8cfd3uqegh38fep3vpfk1sb78m991kgicj66kla3ngh3oq1dptl2pdron422/family1/335779a3807f4e799913fcfe557dbc80 into 8036776dda3d2e3fb58ead3edb012c6e/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/2a3adf15b10a4915bab19c2642d29311_SeqId_44_ - updating store file list. 2023-03-07 10:54:14,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/2a3adf15b10a4915bab19c2642d29311_SeqId_44_ into 8036776dda3d2e3fb58ead3edb012c6e/family1 2023-03-07 10:54:14,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__hko8cfd3uqegh38fep3vpfk1sb78m991kgicj66kla3ngh3oq1dptl2pdron422/family1/335779a3807f4e799913fcfe557dbc80 into 8036776dda3d2e3fb58ead3edb012c6e/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/2a3adf15b10a4915bab19c2642d29311_SeqId_44_) 2023-03-07 10:54:14,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__hko8cfd3uqegh38fep3vpfk1sb78m991kgicj66kla3ngh3oq1dptl2pdron422/family1/335779a3807f4e799913fcfe557dbc80 2023-03-07 10:54:14,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-07 10:54:14,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-07 10:54:14,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(1912): 8036776dda3d2e3fb58ead3edb012c6e/family1 is initiating minor compaction 2023-03-07 10:54:14,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@301a183a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:54:14,724 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 8036776dda3d2e3fb58ead3edb012c6e/family1 in testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:14,724 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/2a55e197b4d44f57ae95368d3f97a9dd, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/2af91e6d39764bbd922d44132d4c1f46, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/25a327df1d054791a4fe291293d69529, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/7effaadb7f8248e78efe83da2c49f781, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/97e9dcb684e143c9bc2f704036a51755, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/836fc4e774ee43adb4f326906bb524fa, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/d519bb71422e49bf852005018da75714, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/f3aabd30440d4938b6c0d0437533e891, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/e3d778e5fb4e4bae8c5d75302a37c825, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/2a3adf15b10a4915bab19c2642d29311_SeqId_44_] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/.tmp, totalSize=50.0 K 2023-03-07 10:54:14,724 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 2a55e197b4d44f57ae95368d3f97a9dd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-07 10:54:14,724 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 2af91e6d39764bbd922d44132d4c1f46, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-07 10:54:14,724 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 25a327df1d054791a4fe291293d69529, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-07 10:54:14,724 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 7effaadb7f8248e78efe83da2c49f781, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-07 10:54:14,724 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 97e9dcb684e143c9bc2f704036a51755, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-07 10:54:14,724 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 836fc4e774ee43adb4f326906bb524fa, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-07 10:54:14,724 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting d519bb71422e49bf852005018da75714, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-07 10:54:14,725 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting f3aabd30440d4938b6c0d0437533e891, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-07 10:54:14,725 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting e3d778e5fb4e4bae8c5d75302a37c825, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-07 10:54:14,725 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 2a3adf15b10a4915bab19c2642d29311_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-07 10:54:14,726 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-07 10:54:14,727 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:54:14,729 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512288d1fc1dcf0114ec8acf90f32141a18ab to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512288d1fc1dcf0114ec8acf90f32141a18ab 2023-03-07 10:54:14,732 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231c614773eb11846d19450a3e6b0338bd1 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231c614773eb11846d19450a3e6b0338bd1 2023-03-07 10:54:14,736 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101dcfd459d2fae44d28d1972046f4be9d7 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101dcfd459d2fae44d28d1972046f4be9d7 2023-03-07 10:54:14,738 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601038f03933539274ef7a391d2219391ae91 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601038f03933539274ef7a391d2219391ae91 2023-03-07 10:54:14,738 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-03-07 10:54:14,738 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-07 10:54:14,739 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-07 10:54:14,739 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-07 10:54:14,739 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-07 10:54:14,739 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-07 10:54:14,739 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-07 10:54:14,739 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-07 10:54:14,739 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-07 10:54:14,739 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-07 10:54:14,788 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8036776dda3d2e3fb58ead3edb012c6e#family1#compaction#34 average throughput is 0.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:54:15,217 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205679a6ef3eb334fcb8c11ab16782fd332 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205679a6ef3eb334fcb8c11ab16782fd332 2023-03-07 10:54:15,219 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-07 10:54:15,238 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/.tmp/family1/b1b0509f8e424a86bd40b7edf8761658 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/b1b0509f8e424a86bd40b7edf8761658 2023-03-07 10:54:15,250 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 8036776dda3d2e3fb58ead3edb012c6e/family1 of 8036776dda3d2e3fb58ead3edb012c6e into b1b0509f8e424a86bd40b7edf8761658(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-07 10:54:15,250 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8036776dda3d2e3fb58ead3edb012c6e: 2023-03-07 10:54:15,250 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1678186454723; duration=0sec 2023-03-07 10:54:15,250 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:54:15,277 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/82d6876441704fda86c1002e95907afa first=Optional[r1] last=Optional[r2] 2023-03-07 10:54:15,280 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/82d6876441704fda86c1002e95907afa}] 2023-03-07 10:54:15,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/82d6876441704fda86c1002e95907afa for inclusion in 8036776dda3d2e3fb58ead3edb012c6e/family1 2023-03-07 10:54:15,293 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/2a55e197b4d44f57ae95368d3f97a9dd, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/2af91e6d39764bbd922d44132d4c1f46, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/25a327df1d054791a4fe291293d69529, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/7effaadb7f8248e78efe83da2c49f781, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/97e9dcb684e143c9bc2f704036a51755, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/836fc4e774ee43adb4f326906bb524fa, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/d519bb71422e49bf852005018da75714, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/f3aabd30440d4938b6c0d0437533e891, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/e3d778e5fb4e4bae8c5d75302a37c825, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/2a3adf15b10a4915bab19c2642d29311_SeqId_44_] to archive 2023-03-07 10:54:15,295 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:54:15,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-03-07 10:54:15,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(777): Region bounds: first= last= 2023-03-07 10:54:15,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for 8036776dda3d2e3fb58ead3edb012c6e: 2023-03-07 10:54:15,297 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/2a55e197b4d44f57ae95368d3f97a9dd to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/2a55e197b4d44f57ae95368d3f97a9dd 2023-03-07 10:54:15,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/82d6876441704fda86c1002e95907afa to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__hk8ea440bvnfd50l4ksu7thqirk5i7eahma5q2msd1485bbdl3c9h4travvcue0o/family1/82d6876441704fda86c1002e95907afa 2023-03-07 10:54:15,299 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/2af91e6d39764bbd922d44132d4c1f46 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/2af91e6d39764bbd922d44132d4c1f46 2023-03-07 10:54:15,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/25a327df1d054791a4fe291293d69529 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/25a327df1d054791a4fe291293d69529 2023-03-07 10:54:15,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__hk8ea440bvnfd50l4ksu7thqirk5i7eahma5q2msd1485bbdl3c9h4travvcue0o/family1/82d6876441704fda86c1002e95907afa as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/29b6b822303945d88b32bf8ea1d9213a_SeqId_47_ 2023-03-07 10:54:15,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/7effaadb7f8248e78efe83da2c49f781 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/7effaadb7f8248e78efe83da2c49f781 2023-03-07 10:54:15,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__hk8ea440bvnfd50l4ksu7thqirk5i7eahma5q2msd1485bbdl3c9h4travvcue0o/family1/82d6876441704fda86c1002e95907afa into 8036776dda3d2e3fb58ead3edb012c6e/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/29b6b822303945d88b32bf8ea1d9213a_SeqId_47_ - updating store file list. 2023-03-07 10:54:15,309 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/97e9dcb684e143c9bc2f704036a51755 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/97e9dcb684e143c9bc2f704036a51755 2023-03-07 10:54:15,311 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/836fc4e774ee43adb4f326906bb524fa to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/836fc4e774ee43adb4f326906bb524fa 2023-03-07 10:54:15,313 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/d519bb71422e49bf852005018da75714 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/d519bb71422e49bf852005018da75714 2023-03-07 10:54:15,314 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/f3aabd30440d4938b6c0d0437533e891 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/f3aabd30440d4938b6c0d0437533e891 2023-03-07 10:54:15,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/29b6b822303945d88b32bf8ea1d9213a_SeqId_47_ into 8036776dda3d2e3fb58ead3edb012c6e/family1 2023-03-07 10:54:15,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__hk8ea440bvnfd50l4ksu7thqirk5i7eahma5q2msd1485bbdl3c9h4travvcue0o/family1/82d6876441704fda86c1002e95907afa into 8036776dda3d2e3fb58ead3edb012c6e/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/29b6b822303945d88b32bf8ea1d9213a_SeqId_47_) 2023-03-07 10:54:15,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__hk8ea440bvnfd50l4ksu7thqirk5i7eahma5q2msd1485bbdl3c9h4travvcue0o/family1/82d6876441704fda86c1002e95907afa 2023-03-07 10:54:15,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-07 10:54:15,317 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/e3d778e5fb4e4bae8c5d75302a37c825 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/e3d778e5fb4e4bae8c5d75302a37c825 2023-03-07 10:54:15,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-07 10:54:15,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(1912): 8036776dda3d2e3fb58ead3edb012c6e/family1 is initiating minor compaction (all files) 2023-03-07 10:54:15,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5456323; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:54:15,318 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 8036776dda3d2e3fb58ead3edb012c6e/family1 in testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:54:15,318 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/08a35b46cb3b40f8881489aa807e614d, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/b1b0509f8e424a86bd40b7edf8761658, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/29b6b822303945d88b32bf8ea1d9213a_SeqId_47_] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/.tmp, totalSize=176.8 K 2023-03-07 10:54:15,319 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 08a35b46cb3b40f8881489aa807e614d, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878838856 2023-03-07 10:54:15,320 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting b1b0509f8e424a86bd40b7edf8761658, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621238856 2023-03-07 10:54:15,320 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 29b6b822303945d88b32bf8ea1d9213a_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965238856 2023-03-07 10:54:15,321 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-07 10:54:15,322 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:54:15,324 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/2a3adf15b10a4915bab19c2642d29311_SeqId_44_ to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/2a3adf15b10a4915bab19c2642d29311_SeqId_44_ 2023-03-07 10:54:15,325 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512011d1ce345f45146f0af4068cb017e44fe to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512011d1ce345f45146f0af4068cb017e44fe 2023-03-07 10:54:15,330 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120541e9a672d3484d2194ebcc20379f2b7d to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120541e9a672d3484d2194ebcc20379f2b7d 2023-03-07 10:54:15,330 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-03-07 10:54:15,330 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-07 10:54:15,331 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-07 10:54:15,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-07 10:54:15,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:54:15,337 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-07 10:54:15,340 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.1930 sec 2023-03-07 10:54:15,357 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8036776dda3d2e3fb58ead3edb012c6e#family1#compaction#35 average throughput is 10.31 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:54:15,479 INFO [Listener at localhost/42383] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=251 (was 255), OpenFileDescriptor=589 (was 607), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=274 (was 305), ProcessCount=171 (was 171), AvailableMemoryMB=10000 (was 10043) 2023-03-07 10:54:15,494 INFO [Listener at localhost/42383] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=251, OpenFileDescriptor=589, MaxFileDescriptor=60000, SystemLoadAverage=274, ProcessCount=171, AvailableMemoryMB=9999 2023-03-07 10:54:15,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-07 10:54:15,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:15,501 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-03-07 10:54:15,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-03-07 10:54:15,502 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-07 10:54:15,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-07 10:54:15,510 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/96cb7465ccbd98f86b820ce4ec50f4cd 2023-03-07 10:54:15,510 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4376407ee845091c523fcd53b992a700 2023-03-07 10:54:15,512 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/96cb7465ccbd98f86b820ce4ec50f4cd empty. 2023-03-07 10:54:15,512 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a 2023-03-07 10:54:15,512 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4376407ee845091c523fcd53b992a700 empty. 2023-03-07 10:54:15,512 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/96cb7465ccbd98f86b820ce4ec50f4cd 2023-03-07 10:54:15,513 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4376407ee845091c523fcd53b992a700 2023-03-07 10:54:15,513 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a empty. 2023-03-07 10:54:15,513 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a 2023-03-07 10:54:15,513 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-03-07 10:54:15,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-07 10:54:15,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-07 10:54:15,932 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-03-07 10:54:15,935 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => b608a9e3d8c5353819a8a23fbe06300a, NAME => 'testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp 2023-03-07 10:54:15,935 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 96cb7465ccbd98f86b820ce4ec50f4cd, NAME => 'testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp 2023-03-07 10:54:15,935 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4376407ee845091c523fcd53b992a700, NAME => 'testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp 2023-03-07 10:54:15,969 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:54:15,969 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 4376407ee845091c523fcd53b992a700, disabling compactions & flushes 2023-03-07 10:54:15,969 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700. 2023-03-07 10:54:15,969 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700. 2023-03-07 10:54:15,969 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700. after waiting 0 ms 2023-03-07 10:54:15,969 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700. 2023-03-07 10:54:15,969 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700. 2023-03-07 10:54:15,969 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 4376407ee845091c523fcd53b992a700: 2023-03-07 10:54:16,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-07 10:54:16,225 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/.tmp/family1/7e6acb683b184b2492fcd2d43a3b8a35 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/7e6acb683b184b2492fcd2d43a3b8a35 2023-03-07 10:54:16,231 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 8036776dda3d2e3fb58ead3edb012c6e/family1 of 8036776dda3d2e3fb58ead3edb012c6e into 7e6acb683b184b2492fcd2d43a3b8a35(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-07 10:54:16,231 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8036776dda3d2e3fb58ead3edb012c6e: 2023-03-07 10:54:16,231 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1678186455318; duration=0sec 2023-03-07 10:54:16,231 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:54:16,270 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/08a35b46cb3b40f8881489aa807e614d, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/b1b0509f8e424a86bd40b7edf8761658, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/29b6b822303945d88b32bf8ea1d9213a_SeqId_47_] to archive 2023-03-07 10:54:16,271 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:54:16,274 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/08a35b46cb3b40f8881489aa807e614d to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/08a35b46cb3b40f8881489aa807e614d 2023-03-07 10:54:16,275 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/b1b0509f8e424a86bd40b7edf8761658 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/b1b0509f8e424a86bd40b7edf8761658 2023-03-07 10:54:16,277 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/29b6b822303945d88b32bf8ea1d9213a_SeqId_47_ to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/family1/29b6b822303945d88b32bf8ea1d9213a_SeqId_47_ 2023-03-07 10:54:16,359 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:54:16,359 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 96cb7465ccbd98f86b820ce4ec50f4cd, disabling compactions & flushes 2023-03-07 10:54:16,359 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd. 2023-03-07 10:54:16,359 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd. 2023-03-07 10:54:16,359 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd. after waiting 0 ms 2023-03-07 10:54:16,359 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd. 2023-03-07 10:54:16,360 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd. 2023-03-07 10:54:16,360 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 96cb7465ccbd98f86b820ce4ec50f4cd: 2023-03-07 10:54:16,361 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:54:16,361 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing b608a9e3d8c5353819a8a23fbe06300a, disabling compactions & flushes 2023-03-07 10:54:16,361 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a. 2023-03-07 10:54:16,361 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a. 2023-03-07 10:54:16,362 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a. after waiting 0 ms 2023-03-07 10:54:16,362 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a. 2023-03-07 10:54:16,362 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a. 2023-03-07 10:54:16,362 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for b608a9e3d8c5353819a8a23fbe06300a: 2023-03-07 10:54:16,365 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-03-07 10:54:16,366 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1678186456366"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186456366"}]},"ts":"1678186456366"} 2023-03-07 10:54:16,366 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678186456366"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186456366"}]},"ts":"1678186456366"} 2023-03-07 10:54:16,366 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678186456366"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186456366"}]},"ts":"1678186456366"} 2023-03-07 10:54:16,370 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-07 10:54:16,371 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-07 10:54:16,371 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186456371"}]},"ts":"1678186456371"} 2023-03-07 10:54:16,373 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-03-07 10:54:16,376 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=96cb7465ccbd98f86b820ce4ec50f4cd, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4376407ee845091c523fcd53b992a700, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b608a9e3d8c5353819a8a23fbe06300a, ASSIGN}] 2023-03-07 10:54:16,378 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4376407ee845091c523fcd53b992a700, ASSIGN 2023-03-07 10:54:16,378 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b608a9e3d8c5353819a8a23fbe06300a, ASSIGN 2023-03-07 10:54:16,379 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=96cb7465ccbd98f86b820ce4ec50f4cd, ASSIGN 2023-03-07 10:54:16,379 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4376407ee845091c523fcd53b992a700, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39673,1678186416064; forceNewPlan=false, retain=false 2023-03-07 10:54:16,379 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b608a9e3d8c5353819a8a23fbe06300a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39673,1678186416064; forceNewPlan=false, retain=false 2023-03-07 10:54:16,379 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=96cb7465ccbd98f86b820ce4ec50f4cd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39673,1678186416064; forceNewPlan=false, retain=false 2023-03-07 10:54:16,532 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=b608a9e3d8c5353819a8a23fbe06300a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:16,532 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=4376407ee845091c523fcd53b992a700, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:16,532 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=96cb7465ccbd98f86b820ce4ec50f4cd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:16,532 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678186456532"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186456532"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186456532"}]},"ts":"1678186456532"} 2023-03-07 10:54:16,532 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1678186456532"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186456532"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186456532"}]},"ts":"1678186456532"} 2023-03-07 10:54:16,532 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678186456532"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186456532"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186456532"}]},"ts":"1678186456532"} 2023-03-07 10:54:16,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=30, state=RUNNABLE; OpenRegionProcedure b608a9e3d8c5353819a8a23fbe06300a, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:54:16,535 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=29, state=RUNNABLE; OpenRegionProcedure 4376407ee845091c523fcd53b992a700, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:54:16,536 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=28, state=RUNNABLE; OpenRegionProcedure 96cb7465ccbd98f86b820ce4ec50f4cd, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:54:16,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-07 10:54:16,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700. 2023-03-07 10:54:16,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4376407ee845091c523fcd53b992a700, NAME => 'testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700.', STARTKEY => '1', ENDKEY => '2'} 2023-03-07 10:54:16,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 4376407ee845091c523fcd53b992a700 2023-03-07 10:54:16,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:54:16,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4376407ee845091c523fcd53b992a700 2023-03-07 10:54:16,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4376407ee845091c523fcd53b992a700 2023-03-07 10:54:16,691 INFO [StoreOpener-4376407ee845091c523fcd53b992a700-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4376407ee845091c523fcd53b992a700 2023-03-07 10:54:16,693 DEBUG [StoreOpener-4376407ee845091c523fcd53b992a700-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/4376407ee845091c523fcd53b992a700/family1 2023-03-07 10:54:16,693 DEBUG [StoreOpener-4376407ee845091c523fcd53b992a700-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/4376407ee845091c523fcd53b992a700/family1 2023-03-07 10:54:16,694 INFO [StoreOpener-4376407ee845091c523fcd53b992a700-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4376407ee845091c523fcd53b992a700 columnFamilyName family1 2023-03-07 10:54:16,695 INFO [StoreOpener-4376407ee845091c523fcd53b992a700-1] regionserver.HStore(310): Store=4376407ee845091c523fcd53b992a700/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:54:16,695 INFO [StoreOpener-4376407ee845091c523fcd53b992a700-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 4376407ee845091c523fcd53b992a700 2023-03-07 10:54:16,697 DEBUG [StoreOpener-4376407ee845091c523fcd53b992a700-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/4376407ee845091c523fcd53b992a700/family2 2023-03-07 10:54:16,697 DEBUG [StoreOpener-4376407ee845091c523fcd53b992a700-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/4376407ee845091c523fcd53b992a700/family2 2023-03-07 10:54:16,697 INFO [StoreOpener-4376407ee845091c523fcd53b992a700-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4376407ee845091c523fcd53b992a700 columnFamilyName family2 2023-03-07 10:54:16,699 INFO [StoreOpener-4376407ee845091c523fcd53b992a700-1] regionserver.HStore(310): Store=4376407ee845091c523fcd53b992a700/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:54:16,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/4376407ee845091c523fcd53b992a700 2023-03-07 10:54:16,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/4376407ee845091c523fcd53b992a700 2023-03-07 10:54:16,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-07 10:54:16,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4376407ee845091c523fcd53b992a700 2023-03-07 10:54:16,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/4376407ee845091c523fcd53b992a700/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-07 10:54:16,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4376407ee845091c523fcd53b992a700; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67798494, jitterRate=0.01027628779411316}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-07 10:54:16,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4376407ee845091c523fcd53b992a700: 2023-03-07 10:54:16,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700., pid=32, masterSystemTime=1678186456686 2023-03-07 10:54:16,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700. 2023-03-07 10:54:16,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700. 2023-03-07 10:54:16,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a. 2023-03-07 10:54:16,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b608a9e3d8c5353819a8a23fbe06300a, NAME => 'testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a.', STARTKEY => '2', ENDKEY => ''} 2023-03-07 10:54:16,708 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=4376407ee845091c523fcd53b992a700, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:16,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles b608a9e3d8c5353819a8a23fbe06300a 2023-03-07 10:54:16,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:54:16,709 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1678186456708"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186456708"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186456708"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186456708"}]},"ts":"1678186456708"} 2023-03-07 10:54:16,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b608a9e3d8c5353819a8a23fbe06300a 2023-03-07 10:54:16,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b608a9e3d8c5353819a8a23fbe06300a 2023-03-07 10:54:16,713 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=29 2023-03-07 10:54:16,713 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=29, state=SUCCESS; OpenRegionProcedure 4376407ee845091c523fcd53b992a700, server=jenkins-hbase4.apache.org,39673,1678186416064 in 176 msec 2023-03-07 10:54:16,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4376407ee845091c523fcd53b992a700, ASSIGN in 337 msec 2023-03-07 10:54:16,720 INFO [StoreOpener-b608a9e3d8c5353819a8a23fbe06300a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b608a9e3d8c5353819a8a23fbe06300a 2023-03-07 10:54:16,721 DEBUG [StoreOpener-b608a9e3d8c5353819a8a23fbe06300a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/family1 2023-03-07 10:54:16,722 DEBUG [StoreOpener-b608a9e3d8c5353819a8a23fbe06300a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/family1 2023-03-07 10:54:16,722 INFO [StoreOpener-b608a9e3d8c5353819a8a23fbe06300a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b608a9e3d8c5353819a8a23fbe06300a columnFamilyName family1 2023-03-07 10:54:16,723 INFO [StoreOpener-b608a9e3d8c5353819a8a23fbe06300a-1] regionserver.HStore(310): Store=b608a9e3d8c5353819a8a23fbe06300a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:54:16,724 INFO [StoreOpener-b608a9e3d8c5353819a8a23fbe06300a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b608a9e3d8c5353819a8a23fbe06300a 2023-03-07 10:54:16,725 DEBUG [StoreOpener-b608a9e3d8c5353819a8a23fbe06300a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/family2 2023-03-07 10:54:16,725 DEBUG [StoreOpener-b608a9e3d8c5353819a8a23fbe06300a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/family2 2023-03-07 10:54:16,726 INFO [StoreOpener-b608a9e3d8c5353819a8a23fbe06300a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b608a9e3d8c5353819a8a23fbe06300a columnFamilyName family2 2023-03-07 10:54:16,727 INFO [StoreOpener-b608a9e3d8c5353819a8a23fbe06300a-1] regionserver.HStore(310): Store=b608a9e3d8c5353819a8a23fbe06300a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:54:16,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a 2023-03-07 10:54:16,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a 2023-03-07 10:54:16,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-07 10:54:16,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b608a9e3d8c5353819a8a23fbe06300a 2023-03-07 10:54:16,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-07 10:54:16,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b608a9e3d8c5353819a8a23fbe06300a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60151794, jitterRate=-0.10366842150688171}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-07 10:54:16,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b608a9e3d8c5353819a8a23fbe06300a: 2023-03-07 10:54:16,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a., pid=31, masterSystemTime=1678186456686 2023-03-07 10:54:16,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a. 2023-03-07 10:54:16,736 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a. 2023-03-07 10:54:16,736 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd. 2023-03-07 10:54:16,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 96cb7465ccbd98f86b820ce4ec50f4cd, NAME => 'testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd.', STARTKEY => '', ENDKEY => '1'} 2023-03-07 10:54:16,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 96cb7465ccbd98f86b820ce4ec50f4cd 2023-03-07 10:54:16,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:54:16,737 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=b608a9e3d8c5353819a8a23fbe06300a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:16,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 96cb7465ccbd98f86b820ce4ec50f4cd 2023-03-07 10:54:16,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 96cb7465ccbd98f86b820ce4ec50f4cd 2023-03-07 10:54:16,737 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678186456737"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186456737"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186456737"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186456737"}]},"ts":"1678186456737"} 2023-03-07 10:54:16,739 INFO [StoreOpener-96cb7465ccbd98f86b820ce4ec50f4cd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 96cb7465ccbd98f86b820ce4ec50f4cd 2023-03-07 10:54:16,740 DEBUG [StoreOpener-96cb7465ccbd98f86b820ce4ec50f4cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/96cb7465ccbd98f86b820ce4ec50f4cd/family1 2023-03-07 10:54:16,740 DEBUG [StoreOpener-96cb7465ccbd98f86b820ce4ec50f4cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/96cb7465ccbd98f86b820ce4ec50f4cd/family1 2023-03-07 10:54:16,741 INFO [StoreOpener-96cb7465ccbd98f86b820ce4ec50f4cd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 96cb7465ccbd98f86b820ce4ec50f4cd columnFamilyName family1 2023-03-07 10:54:16,741 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=30 2023-03-07 10:54:16,741 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=30, state=SUCCESS; OpenRegionProcedure b608a9e3d8c5353819a8a23fbe06300a, server=jenkins-hbase4.apache.org,39673,1678186416064 in 205 msec 2023-03-07 10:54:16,742 INFO [StoreOpener-96cb7465ccbd98f86b820ce4ec50f4cd-1] regionserver.HStore(310): Store=96cb7465ccbd98f86b820ce4ec50f4cd/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:54:16,743 INFO [StoreOpener-96cb7465ccbd98f86b820ce4ec50f4cd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 96cb7465ccbd98f86b820ce4ec50f4cd 2023-03-07 10:54:16,743 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b608a9e3d8c5353819a8a23fbe06300a, ASSIGN in 365 msec 2023-03-07 10:54:16,744 DEBUG [StoreOpener-96cb7465ccbd98f86b820ce4ec50f4cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/96cb7465ccbd98f86b820ce4ec50f4cd/family2 2023-03-07 10:54:16,744 DEBUG [StoreOpener-96cb7465ccbd98f86b820ce4ec50f4cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/96cb7465ccbd98f86b820ce4ec50f4cd/family2 2023-03-07 10:54:16,745 INFO [StoreOpener-96cb7465ccbd98f86b820ce4ec50f4cd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 96cb7465ccbd98f86b820ce4ec50f4cd columnFamilyName family2 2023-03-07 10:54:16,746 INFO [StoreOpener-96cb7465ccbd98f86b820ce4ec50f4cd-1] regionserver.HStore(310): Store=96cb7465ccbd98f86b820ce4ec50f4cd/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:54:16,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/96cb7465ccbd98f86b820ce4ec50f4cd 2023-03-07 10:54:16,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/96cb7465ccbd98f86b820ce4ec50f4cd 2023-03-07 10:54:16,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-07 10:54:16,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 96cb7465ccbd98f86b820ce4ec50f4cd 2023-03-07 10:54:16,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/96cb7465ccbd98f86b820ce4ec50f4cd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-07 10:54:16,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 96cb7465ccbd98f86b820ce4ec50f4cd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71177383, jitterRate=0.06062565743923187}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-07 10:54:16,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 96cb7465ccbd98f86b820ce4ec50f4cd: 2023-03-07 10:54:16,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd., pid=33, masterSystemTime=1678186456686 2023-03-07 10:54:16,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd. 2023-03-07 10:54:16,755 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd. 2023-03-07 10:54:16,756 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=96cb7465ccbd98f86b820ce4ec50f4cd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:16,756 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678186456756"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186456756"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186456756"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186456756"}]},"ts":"1678186456756"} 2023-03-07 10:54:16,759 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=28 2023-03-07 10:54:16,759 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=28, state=SUCCESS; OpenRegionProcedure 96cb7465ccbd98f86b820ce4ec50f4cd, server=jenkins-hbase4.apache.org,39673,1678186416064 in 221 msec 2023-03-07 10:54:16,761 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-03-07 10:54:16,761 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=96cb7465ccbd98f86b820ce4ec50f4cd, ASSIGN in 383 msec 2023-03-07 10:54:16,762 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-07 10:54:16,762 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186456762"}]},"ts":"1678186456762"} 2023-03-07 10:54:16,763 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-03-07 10:54:16,765 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-03-07 10:54:16,767 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2680 sec 2023-03-07 10:54:17,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-07 10:54:17,616 INFO [Listener at localhost/42383] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-03-07 10:54:17,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:17,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:17,625 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-03-07 10:54:17,625 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:17,625 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-03-07 10:54:17,625 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-03-07 10:54:17,625 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:17,625 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:17,628 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:17,628 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:17,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:17,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:17,629 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:17,629 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:17,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:17,629 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:17,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:17,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:17,630 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:17,630 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:17,630 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-03-07 10:54:17,630 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:17,630 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-03-07 10:54:17,630 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a. 2023-03-07 10:54:17,630 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a. started... 2023-03-07 10:54:17,632 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b608a9e3d8c5353819a8a23fbe06300a 2/2 column families, dataSize=48 B heapSize=632 B 2023-03-07 10:54:17,632 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd. 2023-03-07 10:54:17,632 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-07 10:54:17,633 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:17,633 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700. 2023-03-07 10:54:17,632 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd. started... 2023-03-07 10:54:17,633 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700. started... 2023-03-07 10:54:17,633 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 96cb7465ccbd98f86b820ce4ec50f4cd: 2023-03-07 10:54:17,634 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 4376407ee845091c523fcd53b992a700: 2023-03-07 10:54:17,634 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700. 2023-03-07 10:54:17,634 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd. 2023-03-07 10:54:17,634 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-07 10:54:17,634 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-07 10:54:17,649 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230307d018d35c1ceb4ae3a994f99a244c8b39 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230307d018d35c1ceb4ae3a994f99a244c8b39 2023-03-07 10:54:18,059 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/.tmp/family1/036e98f2a3614c65a10c90308181719c 2023-03-07 10:54:18,064 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/.tmp/family1/036e98f2a3614c65a10c90308181719c as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/family1/036e98f2a3614c65a10c90308181719c 2023-03-07 10:54:18,068 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/family1/036e98f2a3614c65a10c90308181719c, entries=1, sequenceid=5, filesize=4.9 K 2023-03-07 10:54:18,069 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for b608a9e3d8c5353819a8a23fbe06300a in 437ms, sequenceid=5, compaction requested=false 2023-03-07 10:54:18,069 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-03-07 10:54:18,070 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b608a9e3d8c5353819a8a23fbe06300a: 2023-03-07 10:54:18,070 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a. 2023-03-07 10:54:18,070 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-07 10:54:18,070 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-07 10:54:18,070 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:18,070 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-03-07 10:54:18,070 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-03-07 10:54:18,071 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,071 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:18,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:18,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:18,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:18,072 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,072 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:18,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:18,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:18,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:18,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:18,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-03-07 10:54:18,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ca2e510[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:18,073 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-03-07 10:54:18,073 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,075 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,075 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-03-07 10:54:18,075 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-03-07 10:54:18,075 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:18,075 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:18,075 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:18,076 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:18,076 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-03-07 10:54:18,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:18,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:18,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:18,076 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:18,076 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-03-07 10:54:18,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:18,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:18,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:18,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:18,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:18,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:18,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-03-07 10:54:18,079 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-03-07 10:54:18,079 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:18,079 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:18,079 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,079 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:18,082 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,082 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,082 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:18,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:18,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:18,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:18,082 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:18,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:18,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:18,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:18,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,083 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:18,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:18,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:18,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:18,089 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:18,089 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:18,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:18,089 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:18,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:18,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-03-07 10:54:18,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:18,089 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:18,089 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,090 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-03-07 10:54:18,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:18,090 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:18,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:18,090 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:18,090 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,090 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:18,090 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,090 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,090 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,190 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:18,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:18,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:18,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:18,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,198 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-03-07 10:54:18,198 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:18,198 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-03-07 10:54:18,198 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-03-07 10:54:18,198 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,198 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,200 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:18,200 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:18,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:18,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:18,200 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:18,200 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:18,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,200 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:18,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,201 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,201 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-03-07 10:54:18,201 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:18,201 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-03-07 10:54:18,201 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:18,201 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-03-07 10:54:18,202 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a. 2023-03-07 10:54:18,202 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-07 10:54:18,202 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a. started... 2023-03-07 10:54:18,202 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700. 2023-03-07 10:54:18,202 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:18,202 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b608a9e3d8c5353819a8a23fbe06300a 2/2 column families, dataSize=90 B heapSize=752 B 2023-03-07 10:54:18,202 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd. 2023-03-07 10:54:18,202 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700. started... 2023-03-07 10:54:18,202 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd. started... 2023-03-07 10:54:18,202 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 96cb7465ccbd98f86b820ce4ec50f4cd: 2023-03-07 10:54:18,202 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd. 2023-03-07 10:54:18,202 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 4376407ee845091c523fcd53b992a700: 2023-03-07 10:54:18,202 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-07 10:54:18,202 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700. 2023-03-07 10:54:18,202 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-07 10:54:18,620 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023030738c34180d4554b0282fcff762236d0f0 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023030738c34180d4554b0282fcff762236d0f0 2023-03-07 10:54:19,025 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/.tmp/family1/8d3c155259064d499984c64a2e2dcd99 2023-03-07 10:54:19,030 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/.tmp/family1/8d3c155259064d499984c64a2e2dcd99 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/family1/8d3c155259064d499984c64a2e2dcd99 2023-03-07 10:54:19,035 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/family1/8d3c155259064d499984c64a2e2dcd99, entries=2, sequenceid=9, filesize=5.0 K 2023-03-07 10:54:19,035 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for b608a9e3d8c5353819a8a23fbe06300a in 833ms, sequenceid=9, compaction requested=false 2023-03-07 10:54:19,036 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b608a9e3d8c5353819a8a23fbe06300a: 2023-03-07 10:54:19,036 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a. 2023-03-07 10:54:19,036 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-07 10:54:19,036 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-07 10:54:19,036 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:19,036 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-03-07 10:54:19,036 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-03-07 10:54:19,039 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:19,039 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:19,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:19,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:19,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:19,039 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:19,039 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:19,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:19,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:19,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:19,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:19,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:19,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-03-07 10:54:19,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d6fb6a[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:19,041 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-03-07 10:54:19,041 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:19,042 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:19,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:19,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:19,042 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-03-07 10:54:19,042 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-03-07 10:54:19,042 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:19,042 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:19,042 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:19,044 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:19,044 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-03-07 10:54:19,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:19,044 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:19,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:19,044 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-03-07 10:54:19,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:19,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:19,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:19,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:19,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:19,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:19,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:19,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:19,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:19,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-03-07 10:54:19,046 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-03-07 10:54:19,046 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:19,046 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:19,046 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:19,046 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:19,048 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:19,048 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:19,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:19,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:19,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:19,048 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:19,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:19,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:19,049 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:19,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:19,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:19,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:19,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:19,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:19,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:19,050 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:19,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:19,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:19,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:19,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:19,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:19,053 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:19,053 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:19,053 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:19,053 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:19,053 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:19,053 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:19,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-03-07 10:54:19,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:19,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:19,053 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:19,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:19,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-03-07 10:54:19,053 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:19,053 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:19,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:19,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:19,053 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:19,053 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:19,054 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:19,154 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:19,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:19,161 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45579] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-03-07 10:54:19,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-07 10:54:19,164 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-07 10:54:19,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:54:19,164 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678187059164 2023-03-07 10:54:19,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-07 10:54:19,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-03-07 10:54:19,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-07 10:54:19,166 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] zookeeper.ReadOnlyZKClient(139): Connect 0x7601903e to 127.0.0.1:56055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-07 10:54:19,174 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7800d237, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-07 10:54:19,175 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230307 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-03-07 10:54:20,003 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230307fc3f5dca91c848f4894b17154187cff7 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230307fc3f5dca91c848f4894b17154187cff7 2023-03-07 10:54:20,004 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230307 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-07 10:54:20,018 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-07 10:54:20,019 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48192, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-07 10:54:20,027 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-07 10:54:20,029 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52700, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-07 10:54:20,038 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230307/family1/f3c2390c61e743d2ab97e08b92521d77 first=Optional[k0] last=Optional[k1] 2023-03-07 10:54:20,039 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230307/family1/f3c2390c61e743d2ab97e08b92521d77}] 2023-03-07 10:54:20,043 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230307/family1/f3c2390c61e743d2ab97e08b92521d77 for inclusion in b608a9e3d8c5353819a8a23fbe06300a/family1 2023-03-07 10:54:20,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-03-07 10:54:20,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-07 10:54:20,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for b608a9e3d8c5353819a8a23fbe06300a: 2023-03-07 10:54:20,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230307/family1/f3c2390c61e743d2ab97e08b92521d77 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testScannerOnBulkLoadRefHFiles__cc21b3nki06044r25o3b3v8argo6pghgibqbptrlef3m4tackssj9poheju3ib8r/family1/f3c2390c61e743d2ab97e08b92521d77 2023-03-07 10:54:20,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testScannerOnBulkLoadRefHFiles__cc21b3nki06044r25o3b3v8argo6pghgibqbptrlef3m4tackssj9poheju3ib8r/family1/f3c2390c61e743d2ab97e08b92521d77 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/family1/a1829e640a084ef2aa8868c19784a54a_SeqId_12_ 2023-03-07 10:54:20,049 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testScannerOnBulkLoadRefHFiles__cc21b3nki06044r25o3b3v8argo6pghgibqbptrlef3m4tackssj9poheju3ib8r/family1/f3c2390c61e743d2ab97e08b92521d77 into b608a9e3d8c5353819a8a23fbe06300a/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/family1/a1829e640a084ef2aa8868c19784a54a_SeqId_12_ - updating store file list. 2023-03-07 10:54:20,053 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/family1/a1829e640a084ef2aa8868c19784a54a_SeqId_12_ into b608a9e3d8c5353819a8a23fbe06300a/family1 2023-03-07 10:54:20,054 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testScannerOnBulkLoadRefHFiles__cc21b3nki06044r25o3b3v8argo6pghgibqbptrlef3m4tackssj9poheju3ib8r/family1/f3c2390c61e743d2ab97e08b92521d77 into b608a9e3d8c5353819a8a23fbe06300a/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/family1/a1829e640a084ef2aa8868c19784a54a_SeqId_12_) 2023-03-07 10:54:20,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testScannerOnBulkLoadRefHFiles__cc21b3nki06044r25o3b3v8argo6pghgibqbptrlef3m4tackssj9poheju3ib8r/family1/f3c2390c61e743d2ab97e08b92521d77 2023-03-07 10:54:20,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-07 10:54:20,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-07 10:54:20,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(1912): b608a9e3d8c5353819a8a23fbe06300a/family1 is initiating minor compaction (all files) 2023-03-07 10:54:20,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1b80df02; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:54:20,056 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b608a9e3d8c5353819a8a23fbe06300a/family1 in testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a. 2023-03-07 10:54:20,056 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/family1/036e98f2a3614c65a10c90308181719c, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/family1/8d3c155259064d499984c64a2e2dcd99, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/family1/a1829e640a084ef2aa8868c19784a54a_SeqId_12_] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/.tmp, totalSize=15.1 K 2023-03-07 10:54:20,057 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 036e98f2a3614c65a10c90308181719c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678186457616 2023-03-07 10:54:20,057 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 8d3c155259064d499984c64a2e2dcd99, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678186457616 2023-03-07 10:54:20,058 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting a1829e640a084ef2aa8868c19784a54a_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678186457616 2023-03-07 10:54:20,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230307 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-07 10:54:20,059 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:54:20,061 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023030738c34180d4554b0282fcff762236d0f0 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023030738c34180d4554b0282fcff762236d0f0 2023-03-07 10:54:20,062 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230307d018d35c1ceb4ae3a994f99a244c8b39 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230307d018d35c1ceb4ae3a994f99a244c8b39 2023-03-07 10:54:20,062 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-03-07 10:54:20,062 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230307' 2023-03-07 10:54:20,062 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230307 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-03-07 10:54:20,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-07 10:54:20,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:54:20,063 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-07 10:54:20,065 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 901 msec 2023-03-07 10:54:20,068 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] throttle.PressureAwareThroughputController(145): b608a9e3d8c5353819a8a23fbe06300a#family1#compaction#38 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:54:20,102 INFO [Listener at localhost/42383] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=250 (was 251), OpenFileDescriptor=589 (was 589), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=260 (was 274), ProcessCount=171 (was 171), AvailableMemoryMB=9420 (was 9999) 2023-03-07 10:54:20,112 INFO [Listener at localhost/42383] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=250, OpenFileDescriptor=589, MaxFileDescriptor=60000, SystemLoadAverage=260, ProcessCount=171, AvailableMemoryMB=9419 2023-03-07 10:54:20,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-07 10:54:20,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:20,116 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-07 10:54:20,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-03-07 10:54:20,117 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-07 10:54:20,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-07 10:54:20,118 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6 2023-03-07 10:54:20,119 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6 empty. 2023-03-07 10:54:20,119 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6 2023-03-07 10:54:20,119 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-03-07 10:54:20,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-07 10:54:20,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-07 10:54:20,527 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-07 10:54:20,529 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => e9afcd90942935584307bde41071b5e6, NAME => 'testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp 2023-03-07 10:54:20,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-07 10:54:20,889 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/.tmp/family1/0ab14ef9e414494e9b8cf0deb0122ba4 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/family1/0ab14ef9e414494e9b8cf0deb0122ba4 2023-03-07 10:54:20,895 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in b608a9e3d8c5353819a8a23fbe06300a/family1 of b608a9e3d8c5353819a8a23fbe06300a into 0ab14ef9e414494e9b8cf0deb0122ba4(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-07 10:54:20,895 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b608a9e3d8c5353819a8a23fbe06300a: 2023-03-07 10:54:20,895 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1678186460056; duration=0sec 2023-03-07 10:54:20,895 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:54:20,935 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:54:20,935 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing e9afcd90942935584307bde41071b5e6, disabling compactions & flushes 2023-03-07 10:54:20,935 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:20,935 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:20,936 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. after waiting 0 ms 2023-03-07 10:54:20,936 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:20,936 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:20,936 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for e9afcd90942935584307bde41071b5e6: 2023-03-07 10:54:20,938 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-07 10:54:20,939 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678186460939"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186460939"}]},"ts":"1678186460939"} 2023-03-07 10:54:20,940 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-07 10:54:20,941 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-07 10:54:20,941 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186460941"}]},"ts":"1678186460941"} 2023-03-07 10:54:20,942 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-03-07 10:54:20,945 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=e9afcd90942935584307bde41071b5e6, ASSIGN}] 2023-03-07 10:54:20,946 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=e9afcd90942935584307bde41071b5e6, ASSIGN 2023-03-07 10:54:20,947 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=e9afcd90942935584307bde41071b5e6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39673,1678186416064; forceNewPlan=false, retain=false 2023-03-07 10:54:20,968 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/family1/036e98f2a3614c65a10c90308181719c, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/family1/8d3c155259064d499984c64a2e2dcd99, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/family1/a1829e640a084ef2aa8868c19784a54a_SeqId_12_] to archive 2023-03-07 10:54:20,969 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:54:20,971 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/family1/036e98f2a3614c65a10c90308181719c to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/family1/036e98f2a3614c65a10c90308181719c 2023-03-07 10:54:20,973 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/family1/8d3c155259064d499984c64a2e2dcd99 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/family1/8d3c155259064d499984c64a2e2dcd99 2023-03-07 10:54:20,974 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/family1/a1829e640a084ef2aa8868c19784a54a_SeqId_12_ to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/family1/a1829e640a084ef2aa8868c19784a54a_SeqId_12_ 2023-03-07 10:54:21,098 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=e9afcd90942935584307bde41071b5e6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:21,098 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678186461098"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186461098"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186461098"}]},"ts":"1678186461098"} 2023-03-07 10:54:21,100 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure e9afcd90942935584307bde41071b5e6, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:54:21,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-07 10:54:21,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:21,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e9afcd90942935584307bde41071b5e6, NAME => 'testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6.', STARTKEY => '', ENDKEY => ''} 2023-03-07 10:54:21,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy e9afcd90942935584307bde41071b5e6 2023-03-07 10:54:21,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:54:21,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e9afcd90942935584307bde41071b5e6 2023-03-07 10:54:21,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e9afcd90942935584307bde41071b5e6 2023-03-07 10:54:21,257 INFO [StoreOpener-e9afcd90942935584307bde41071b5e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e9afcd90942935584307bde41071b5e6 2023-03-07 10:54:21,258 DEBUG [StoreOpener-e9afcd90942935584307bde41071b5e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1 2023-03-07 10:54:21,258 DEBUG [StoreOpener-e9afcd90942935584307bde41071b5e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1 2023-03-07 10:54:21,259 INFO [StoreOpener-e9afcd90942935584307bde41071b5e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9afcd90942935584307bde41071b5e6 columnFamilyName family1 2023-03-07 10:54:21,260 INFO [StoreOpener-e9afcd90942935584307bde41071b5e6-1] regionserver.HStore(310): Store=e9afcd90942935584307bde41071b5e6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:54:21,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6 2023-03-07 10:54:21,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6 2023-03-07 10:54:21,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e9afcd90942935584307bde41071b5e6 2023-03-07 10:54:21,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-07 10:54:21,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e9afcd90942935584307bde41071b5e6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63126958, jitterRate=-0.059335023164749146}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-07 10:54:21,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e9afcd90942935584307bde41071b5e6: 2023-03-07 10:54:21,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6., pid=37, masterSystemTime=1678186461252 2023-03-07 10:54:21,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:21,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:21,269 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=e9afcd90942935584307bde41071b5e6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:21,269 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678186461269"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186461269"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186461269"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186461269"}]},"ts":"1678186461269"} 2023-03-07 10:54:21,272 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-03-07 10:54:21,272 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure e9afcd90942935584307bde41071b5e6, server=jenkins-hbase4.apache.org,39673,1678186416064 in 171 msec 2023-03-07 10:54:21,274 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-03-07 10:54:21,274 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=e9afcd90942935584307bde41071b5e6, ASSIGN in 327 msec 2023-03-07 10:54:21,275 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-07 10:54:21,275 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186461275"}]},"ts":"1678186461275"} 2023-03-07 10:54:21,276 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-03-07 10:54:21,278 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-07 10:54:21,279 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1640 sec 2023-03-07 10:54:22,217 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-07 10:54:22,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-07 10:54:22,223 INFO [Listener at localhost/42383] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-03-07 10:54:22,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:22,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,255 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-07 10:54:22,255 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:22,255 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-07 10:54:22,256 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-07 10:54:22,256 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,256 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,258 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:22,258 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:22,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:22,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:22,258 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:22,259 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:22,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:22,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,259 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,259 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,259 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-07 10:54:22,260 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:22,260 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-07 10:54:22,260 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:22,260 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:22,260 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:22,260 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. started... 2023-03-07 10:54:22,261 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e9afcd90942935584307bde41071b5e6 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-07 10:54:22,280 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511304dd4a10330444df1bd45a1329e08658c to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511304dd4a10330444df1bd45a1329e08658c 2023-03-07 10:54:22,684 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/.tmp/family1/8b672d97d1d74f8c9bb561e8d62c80c7 2023-03-07 10:54:22,689 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/.tmp/family1/8b672d97d1d74f8c9bb561e8d62c80c7 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/8b672d97d1d74f8c9bb561e8d62c80c7 2023-03-07 10:54:22,693 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/8b672d97d1d74f8c9bb561e8d62c80c7, entries=1000, sequenceid=5, filesize=165.1 K 2023-03-07 10:54:22,694 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for e9afcd90942935584307bde41071b5e6 in 433ms, sequenceid=5, compaction requested=false 2023-03-07 10:54:22,694 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-03-07 10:54:22,694 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e9afcd90942935584307bde41071b5e6: 2023-03-07 10:54:22,695 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:22,695 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:22,695 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:22,695 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:22,695 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-07 10:54:22,695 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-07 10:54:22,696 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:22,696 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:22,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:22,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:22,697 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,697 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:22,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:22,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:22,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:22,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:22,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-07 10:54:22,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@661f75b[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:22,698 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-07 10:54:22,698 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,699 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,700 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-07 10:54:22,700 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-07 10:54:22,700 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:22,700 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:22,700 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:22,701 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-07 10:54:22,701 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:22,701 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:22,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:22,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:22,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:22,701 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-07 10:54:22,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:22,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:22,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:22,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:22,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:22,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:22,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:54:22,703 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-07 10:54:22,703 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:22,703 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:22,704 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,704 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:22,706 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,706 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:22,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:22,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,706 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:22,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:22,706 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:22,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:22,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:22,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:22,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,707 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:22,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:22,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:22,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:22,709 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:22,709 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,709 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:22,709 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:22,709 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:22,709 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-07 10:54:22,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:22,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:22,710 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:22,710 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,710 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,710 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:22,710 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:22,710 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:22,710 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-07 10:54:22,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:22,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:22,810 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:22,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:22,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:22,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:22,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,817 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-07 10:54:22,817 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:22,817 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-07 10:54:22,817 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-07 10:54:22,817 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,817 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,819 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:22,819 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:22,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:22,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:22,819 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:22,819 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:22,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:22,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,820 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,820 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-07 10:54:22,820 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:22,820 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-07 10:54:22,820 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:22,820 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-07 10:54:22,820 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:22,820 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:22,820 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:22,820 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. started... 2023-03-07 10:54:22,821 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e9afcd90942935584307bde41071b5e6 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-07 10:54:23,233 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511288ed3a8fc26ce42308a15e01b28cf386e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511288ed3a8fc26ce42308a15e01b28cf386e 2023-03-07 10:54:23,640 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/.tmp/family1/57fcb68f23ab441e8cca01b18a974118 2023-03-07 10:54:23,645 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/.tmp/family1/57fcb68f23ab441e8cca01b18a974118 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/57fcb68f23ab441e8cca01b18a974118 2023-03-07 10:54:23,649 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/57fcb68f23ab441e8cca01b18a974118, entries=1, sequenceid=9, filesize=5.0 K 2023-03-07 10:54:23,650 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for e9afcd90942935584307bde41071b5e6 in 829ms, sequenceid=9, compaction requested=false 2023-03-07 10:54:23,650 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e9afcd90942935584307bde41071b5e6: 2023-03-07 10:54:23,650 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:23,651 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:23,651 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:23,651 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:23,651 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-07 10:54:23,651 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-07 10:54:23,652 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:23,652 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:23,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:23,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:23,653 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,653 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:23,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:23,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:23,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:23,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:23,654 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-07 10:54:23,654 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f735dab[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:23,654 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-07 10:54:23,654 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,659 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,659 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-07 10:54:23,659 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-07 10:54:23,659 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:23,660 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:23,659 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:23,661 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:23,661 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-07 10:54:23,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:23,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:23,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:23,661 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:23,661 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-07 10:54:23,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:23,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:23,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:23,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:23,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:23,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:23,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:54:23,663 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-07 10:54:23,663 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:23,663 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:23,663 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,663 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:23,665 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,665 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:23,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:23,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,665 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:23,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:23,665 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:23,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:23,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:23,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:23,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,666 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:23,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:23,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:23,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:23,668 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:23,668 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:23,668 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-07 10:54:23,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:23,669 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,668 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:23,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:23,668 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:23,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:23,669 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:23,669 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:23,669 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:23,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:23,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:23,669 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,669 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,669 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,769 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:23,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:23,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:23,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:23,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,776 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-07 10:54:23,776 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:23,776 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-07 10:54:23,776 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-07 10:54:23,776 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,776 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,779 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:23,779 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:23,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:23,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:23,779 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:23,779 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:23,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,779 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:23,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,780 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,780 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-07 10:54:23,780 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:23,780 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-07 10:54:23,780 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:23,780 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-07 10:54:23,780 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:23,780 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:23,780 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:23,780 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. started... 2023-03-07 10:54:23,780 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e9afcd90942935584307bde41071b5e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:24,193 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201eb0d9adbc1824d14831ff2af153c6845 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201eb0d9adbc1824d14831ff2af153c6845 2023-03-07 10:54:24,599 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/.tmp/family1/938daae57d4b4a12ae528430e5005473 2023-03-07 10:54:24,603 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/.tmp/family1/938daae57d4b4a12ae528430e5005473 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/938daae57d4b4a12ae528430e5005473 2023-03-07 10:54:24,607 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/938daae57d4b4a12ae528430e5005473, entries=1, sequenceid=13, filesize=4.9 K 2023-03-07 10:54:24,608 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e9afcd90942935584307bde41071b5e6 in 828ms, sequenceid=13, compaction requested=true 2023-03-07 10:54:24,608 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e9afcd90942935584307bde41071b5e6: 2023-03-07 10:54:24,608 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:24,608 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:24,609 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:24,609 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:24,609 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-07 10:54:24,609 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-07 10:54:24,610 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,610 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:24,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:24,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:24,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:24,611 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,611 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:24,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:24,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:24,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:24,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:24,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-07 10:54:24,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1442a730[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:24,612 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-07 10:54:24,612 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,613 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,613 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-07 10:54:24,613 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-07 10:54:24,613 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:24,613 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:24,614 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:24,615 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-07 10:54:24,615 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:24,615 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:24,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:24,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:24,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:24,615 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-07 10:54:24,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:24,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:24,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:24,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:24,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:24,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:24,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:54:24,617 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-07 10:54:24,617 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:24,617 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:24,617 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,617 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:24,620 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,620 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:24,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:24,620 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:24,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,620 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:24,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:24,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:24,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:24,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:24,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,622 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:24,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:24,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:24,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:24,623 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:24,624 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:24,624 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,624 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:24,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-07 10:54:24,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:24,624 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:24,624 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:24,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:24,624 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:24,624 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,624 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,624 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,624 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:24,624 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:24,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:24,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:24,724 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:24,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:24,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:24,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:24,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,731 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-07 10:54:24,731 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:24,731 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-07 10:54:24,731 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-07 10:54:24,732 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,732 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,733 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:24,733 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:24,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:24,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:24,733 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:24,733 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:24,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,734 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:24,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,734 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,734 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-07 10:54:24,734 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:24,734 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-07 10:54:24,734 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:24,734 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-07 10:54:24,734 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:24,734 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:24,735 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:24,735 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. started... 2023-03-07 10:54:24,735 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e9afcd90942935584307bde41071b5e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:25,147 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205d6798187c7a54d408b8aa7741d909ca1 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205d6798187c7a54d408b8aa7741d909ca1 2023-03-07 10:54:25,554 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/.tmp/family1/4ec9d6b6ce66481f99632b3c52f3ead5 2023-03-07 10:54:25,559 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/.tmp/family1/4ec9d6b6ce66481f99632b3c52f3ead5 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/4ec9d6b6ce66481f99632b3c52f3ead5 2023-03-07 10:54:25,563 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/4ec9d6b6ce66481f99632b3c52f3ead5, entries=1, sequenceid=17, filesize=4.9 K 2023-03-07 10:54:25,563 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e9afcd90942935584307bde41071b5e6 in 828ms, sequenceid=17, compaction requested=true 2023-03-07 10:54:25,564 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e9afcd90942935584307bde41071b5e6: 2023-03-07 10:54:25,564 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:25,564 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:25,564 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:25,564 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:25,564 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-07 10:54:25,564 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-07 10:54:25,565 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:25,565 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:25,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:25,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:25,566 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,566 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:25,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:25,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:25,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:25,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:25,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-07 10:54:25,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@267d0379[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:25,567 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-07 10:54:25,567 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,568 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,569 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-07 10:54:25,569 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-07 10:54:25,569 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:25,569 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:25,569 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:25,570 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:25,570 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-07 10:54:25,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:25,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:25,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:25,570 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:25,570 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-07 10:54:25,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:25,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:25,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:25,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:25,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:25,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:25,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:54:25,572 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-07 10:54:25,572 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:25,572 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:25,572 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,572 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:25,574 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,574 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:25,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:25,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,575 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:25,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:25,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:25,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:25,575 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:25,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:25,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:25,576 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:25,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:25,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:25,578 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:25,578 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,578 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:25,578 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:25,578 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:25,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:25,578 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:25,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-07 10:54:25,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:25,578 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:25,579 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,579 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,579 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:25,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:25,579 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:25,579 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:25,679 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:25,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:25,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:25,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:25,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,685 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-07 10:54:25,686 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:25,686 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-07 10:54:25,686 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-07 10:54:25,686 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,686 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,687 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:25,687 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:25,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:25,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:25,688 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:25,688 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:25,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,688 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:25,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,688 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,689 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-07 10:54:25,689 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:25,689 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-07 10:54:25,689 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:25,689 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-07 10:54:25,689 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:25,689 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:25,689 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:25,689 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. started... 2023-03-07 10:54:25,689 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e9afcd90942935584307bde41071b5e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:26,102 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228f96c7c039c68448aa3f3dda12763d7d6 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228f96c7c039c68448aa3f3dda12763d7d6 2023-03-07 10:54:26,508 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/.tmp/family1/bfcc804c24ae4af8afc7ba5b505c3999 2023-03-07 10:54:26,513 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/.tmp/family1/bfcc804c24ae4af8afc7ba5b505c3999 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/bfcc804c24ae4af8afc7ba5b505c3999 2023-03-07 10:54:26,517 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/bfcc804c24ae4af8afc7ba5b505c3999, entries=1, sequenceid=21, filesize=4.9 K 2023-03-07 10:54:26,518 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e9afcd90942935584307bde41071b5e6 in 829ms, sequenceid=21, compaction requested=true 2023-03-07 10:54:26,518 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e9afcd90942935584307bde41071b5e6: 2023-03-07 10:54:26,518 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:26,518 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:26,518 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:26,518 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:26,518 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-07 10:54:26,518 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-07 10:54:26,523 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:26,523 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:26,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:26,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:26,524 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,524 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:26,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:26,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:26,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:26,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:26,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-07 10:54:26,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2faff3c2[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:26,525 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-07 10:54:26,525 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,527 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,527 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-07 10:54:26,527 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-07 10:54:26,527 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:26,527 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:26,527 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:26,528 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:26,528 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-07 10:54:26,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:26,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:26,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:26,529 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:26,529 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-07 10:54:26,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:26,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:26,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:26,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:26,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:26,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:26,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:54:26,531 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-07 10:54:26,531 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:26,531 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:26,531 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,531 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:26,532 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,532 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:26,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:26,532 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:26,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:26,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:26,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:26,533 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:26,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:26,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,534 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:26,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:26,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:26,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:26,536 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:26,536 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:26,536 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-07 10:54:26,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:26,536 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:26,536 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:26,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:26,536 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,537 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-07 10:54:26,537 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:26,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:26,537 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:26,537 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:26,537 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,537 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,537 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:26,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:26,637 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:26,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:26,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:26,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:26,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,644 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-07 10:54:26,644 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:26,644 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-07 10:54:26,644 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-07 10:54:26,645 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,645 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,646 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:26,646 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:26,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:26,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:26,646 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:26,646 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:26,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,647 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:26,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,647 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,647 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-07 10:54:26,647 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:26,647 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-07 10:54:26,647 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:26,647 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-07 10:54:26,648 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:26,648 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:26,648 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:26,648 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. started... 2023-03-07 10:54:26,648 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e9afcd90942935584307bde41071b5e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:27,061 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231d6a410d654164662826bdedf87e8e081 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231d6a410d654164662826bdedf87e8e081 2023-03-07 10:54:27,467 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/.tmp/family1/6b9f48fec48d429d85c9b56033682721 2023-03-07 10:54:27,472 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/.tmp/family1/6b9f48fec48d429d85c9b56033682721 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/6b9f48fec48d429d85c9b56033682721 2023-03-07 10:54:27,476 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/6b9f48fec48d429d85c9b56033682721, entries=1, sequenceid=25, filesize=4.9 K 2023-03-07 10:54:27,477 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e9afcd90942935584307bde41071b5e6 in 829ms, sequenceid=25, compaction requested=true 2023-03-07 10:54:27,477 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e9afcd90942935584307bde41071b5e6: 2023-03-07 10:54:27,477 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:27,477 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:27,477 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:27,477 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:27,477 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-07 10:54:27,478 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-07 10:54:27,479 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,479 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:27,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:27,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:27,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:27,479 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,479 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:27,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:27,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:27,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:27,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:27,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-07 10:54:27,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a046d99[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:27,481 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-07 10:54:27,481 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,482 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,482 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:27,482 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:27,482 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-07 10:54:27,482 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-07 10:54:27,482 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:27,485 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:27,485 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-07 10:54:27,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:27,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:27,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:27,485 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:27,485 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-07 10:54:27,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:27,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:27,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:27,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:27,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:27,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:27,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:54:27,488 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-07 10:54:27,488 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:27,488 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:27,488 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,488 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:27,489 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,489 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:27,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,490 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:27,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:27,490 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:27,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:27,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:27,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:27,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:27,491 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:27,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:27,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:27,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:27,494 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:27,494 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:27,494 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:27,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:27,494 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:27,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-07 10:54:27,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:27,494 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:27,494 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,494 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-07 10:54:27,494 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:27,494 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,494 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:27,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:27,495 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:27,494 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:27,495 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,595 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:27,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:27,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:27,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:27,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,601 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-07 10:54:27,601 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:27,601 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-07 10:54:27,601 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-07 10:54:27,602 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,602 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,603 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:27,603 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:27,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:27,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:27,603 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:27,603 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:27,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,604 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:27,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,604 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,604 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-07 10:54:27,604 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:27,604 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-07 10:54:27,604 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:27,604 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-07 10:54:27,605 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:27,605 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:27,605 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:27,605 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. started... 2023-03-07 10:54:27,605 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e9afcd90942935584307bde41071b5e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:28,018 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601017d94ef79683c44009f21fe342f132201 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601017d94ef79683c44009f21fe342f132201 2023-03-07 10:54:28,423 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/.tmp/family1/a3a318d84c4b4cd1a4f5d4c924f8a29e 2023-03-07 10:54:28,428 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/.tmp/family1/a3a318d84c4b4cd1a4f5d4c924f8a29e as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/a3a318d84c4b4cd1a4f5d4c924f8a29e 2023-03-07 10:54:28,432 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/a3a318d84c4b4cd1a4f5d4c924f8a29e, entries=1, sequenceid=29, filesize=4.9 K 2023-03-07 10:54:28,433 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e9afcd90942935584307bde41071b5e6 in 828ms, sequenceid=29, compaction requested=true 2023-03-07 10:54:28,433 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e9afcd90942935584307bde41071b5e6: 2023-03-07 10:54:28,433 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:28,433 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:28,433 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:28,433 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:28,433 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-07 10:54:28,433 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-07 10:54:28,436 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:28,436 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:28,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:28,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:28,436 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,436 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:28,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:28,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:28,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:28,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:28,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-07 10:54:28,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b7e32ce[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:28,437 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-07 10:54:28,437 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,438 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,439 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-07 10:54:28,439 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-07 10:54:28,439 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:28,439 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:28,439 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:28,440 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-07 10:54:28,440 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:28,440 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:28,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:28,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:28,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:28,440 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-07 10:54:28,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:28,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:28,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:28,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:28,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:28,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:28,442 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:54:28,442 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-07 10:54:28,442 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:28,442 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:28,442 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,442 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:28,444 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,444 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:28,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:28,444 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:28,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:28,444 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:28,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:28,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:28,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:28,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,446 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:28,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:28,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:28,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:28,449 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:28,449 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,449 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,449 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:28,449 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:28,449 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:28,449 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:28,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-07 10:54:28,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:28,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-07 10:54:28,449 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:28,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:28,449 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,449 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,449 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:28,450 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:28,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:28,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:28,550 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:28,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:28,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:28,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:28,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,557 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-07 10:54:28,557 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:28,557 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-07 10:54:28,557 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-07 10:54:28,557 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,557 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,560 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:28,561 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:28,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:28,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:28,561 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:28,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,561 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:28,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:28,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,562 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,562 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-07 10:54:28,562 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:28,562 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-07 10:54:28,562 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:28,562 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-07 10:54:28,562 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:28,562 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:28,562 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:28,562 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. started... 2023-03-07 10:54:28,562 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e9afcd90942935584307bde41071b5e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:28,975 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601033d985b40e089428c9e0a6ee0887bcd31 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601033d985b40e089428c9e0a6ee0887bcd31 2023-03-07 10:54:29,381 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/.tmp/family1/87731a46bec3418b9b9e92295dbceab4 2023-03-07 10:54:29,385 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/.tmp/family1/87731a46bec3418b9b9e92295dbceab4 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/87731a46bec3418b9b9e92295dbceab4 2023-03-07 10:54:29,389 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/87731a46bec3418b9b9e92295dbceab4, entries=1, sequenceid=33, filesize=4.9 K 2023-03-07 10:54:29,390 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e9afcd90942935584307bde41071b5e6 in 828ms, sequenceid=33, compaction requested=true 2023-03-07 10:54:29,390 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e9afcd90942935584307bde41071b5e6: 2023-03-07 10:54:29,390 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:29,390 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:29,390 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:29,390 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:29,390 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-07 10:54:29,390 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-07 10:54:29,392 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,392 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:29,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:29,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:29,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:29,392 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,392 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:29,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:29,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:29,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:29,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:29,393 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-07 10:54:29,393 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55d69c13[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:29,393 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-07 10:54:29,393 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,395 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,396 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-07 10:54:29,396 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-07 10:54:29,396 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:29,396 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:29,396 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:29,397 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:29,397 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-07 10:54:29,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:29,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:29,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:29,397 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:29,397 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-07 10:54:29,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:29,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:29,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:29,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:29,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:29,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:29,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:54:29,399 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-07 10:54:29,399 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:29,399 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:29,399 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,399 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:29,401 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,401 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:29,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:29,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,401 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:29,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:29,401 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:29,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:29,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:29,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:29,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:29,402 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:29,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:29,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:29,405 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:29,405 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:29,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:29,405 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:29,405 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-07 10:54:29,405 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:29,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-07 10:54:29,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:29,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:29,405 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,406 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,406 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:29,406 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,406 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,406 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:29,406 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:29,406 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:29,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:29,506 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:29,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:29,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:29,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:29,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,513 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-07 10:54:29,513 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:29,513 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-07 10:54:29,513 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-07 10:54:29,513 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,513 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,515 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:29,515 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:29,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:29,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:29,516 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:29,516 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:29,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:29,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,516 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,517 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-07 10:54:29,517 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:29,517 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-07 10:54:29,517 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:29,517 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-07 10:54:29,517 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:29,517 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:29,517 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:29,517 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. started... 2023-03-07 10:54:29,517 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e9afcd90942935584307bde41071b5e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:29,930 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907e214e2b034b54353952b4df3a067e915 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20150907e214e2b034b54353952b4df3a067e915 2023-03-07 10:54:30,335 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/.tmp/family1/cbbbdfc8aa894180802918d988ae2750 2023-03-07 10:54:30,340 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/.tmp/family1/cbbbdfc8aa894180802918d988ae2750 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/cbbbdfc8aa894180802918d988ae2750 2023-03-07 10:54:30,344 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/cbbbdfc8aa894180802918d988ae2750, entries=1, sequenceid=37, filesize=4.9 K 2023-03-07 10:54:30,345 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e9afcd90942935584307bde41071b5e6 in 828ms, sequenceid=37, compaction requested=true 2023-03-07 10:54:30,345 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e9afcd90942935584307bde41071b5e6: 2023-03-07 10:54:30,345 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:30,345 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:30,345 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:30,345 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:30,345 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-07 10:54:30,345 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-07 10:54:30,347 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,347 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:30,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:30,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:30,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:30,347 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,347 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:30,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:30,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:30,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:30,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:30,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-07 10:54:30,348 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-07 10:54:30,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b75488[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:30,348 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,349 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,350 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-07 10:54:30,350 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:30,350 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:30,350 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-07 10:54:30,350 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:30,351 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:30,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:30,351 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-07 10:54:30,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:30,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:30,351 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:30,351 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-07 10:54:30,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:30,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:30,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:30,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:30,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:30,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:30,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:54:30,353 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-07 10:54:30,353 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:30,353 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:30,353 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,353 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:30,356 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,356 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:30,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:30,356 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:30,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,356 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:30,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:30,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:30,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:30,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:30,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,357 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:30,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:30,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:30,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:30,360 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:30,360 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,360 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,360 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:30,360 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,360 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:30,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-07 10:54:30,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-07 10:54:30,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:30,360 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,360 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,360 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:30,360 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:30,363 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:30,363 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:30,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:30,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:30,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:30,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:30,460 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:30,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:30,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:30,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:30,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,468 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-07 10:54:30,468 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:30,468 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-07 10:54:30,468 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-07 10:54:30,468 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,468 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,470 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:30,470 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:30,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:30,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:30,470 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:30,470 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:30,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:30,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,471 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,471 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-07 10:54:30,472 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:30,472 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-07 10:54:30,472 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:30,472 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-07 10:54:30,472 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:30,472 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:30,472 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:30,472 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. started... 2023-03-07 10:54:30,472 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e9afcd90942935584307bde41071b5e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:30,893 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120e0af2ac3c91749fcab25726270894596 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120e0af2ac3c91749fcab25726270894596 2023-03-07 10:54:31,299 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/.tmp/family1/f33f8433fc384b0e9f1815568579a863 2023-03-07 10:54:31,304 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/.tmp/family1/f33f8433fc384b0e9f1815568579a863 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/f33f8433fc384b0e9f1815568579a863 2023-03-07 10:54:31,307 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/f33f8433fc384b0e9f1815568579a863, entries=1, sequenceid=41, filesize=4.9 K 2023-03-07 10:54:31,308 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e9afcd90942935584307bde41071b5e6 in 836ms, sequenceid=41, compaction requested=true 2023-03-07 10:54:31,308 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e9afcd90942935584307bde41071b5e6: 2023-03-07 10:54:31,308 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:31,309 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:31,309 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:31,309 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:31,309 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-07 10:54:31,309 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-07 10:54:31,310 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:31,310 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:31,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:31,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:31,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:31,311 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:31,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:31,311 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:31,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:31,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:31,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:31,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:31,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-07 10:54:31,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ce68902[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:31,312 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-07 10:54:31,312 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:31,314 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:31,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:31,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:31,314 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-07 10:54:31,314 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-07 10:54:31,314 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:31,314 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:31,314 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:31,315 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-07 10:54:31,315 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:31,316 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:31,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:31,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:31,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:31,316 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-07 10:54:31,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:31,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:31,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:31,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:31,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:31,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:31,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:31,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:31,318 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:54:31,318 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-07 10:54:31,318 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:31,318 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:31,318 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:31,318 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:31,319 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:31,319 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:31,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:31,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:31,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:31,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:31,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:31,319 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:31,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:31,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:31,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:31,320 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:31,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:31,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:31,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:31,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:31,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:31,321 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:31,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:31,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:31,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:31,326 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:31,326 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:31,326 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:31,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-07 10:54:31,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:31,326 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:31,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:31,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:31,326 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:31,326 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:31,327 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:31,327 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:31,326 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-07 10:54:31,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:31,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:31,327 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:31,327 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:31,327 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:31,327 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:31,427 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:31,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:31,429 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45579] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-03-07 10:54:31,430 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-07 10:54:31,431 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-07 10:54:31,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:54:31,432 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678187071432 2023-03-07 10:54:31,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-07 10:54:31,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-03-07 10:54:31,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-07 10:54:31,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] zookeeper.ReadOnlyZKClient(139): Connect 0x71761a10 to 127.0.0.1:56055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-07 10:54:31,440 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a6e9a18, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-07 10:54:31,441 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-07 10:54:32,282 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031c3f97516409490188dd5187333fa1c6 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601031c3f97516409490188dd5187333fa1c6 2023-03-07 10:54:32,283 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-07 10:54:32,295 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-07 10:54:32,296 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38532, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-07 10:54:32,302 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-07 10:54:32,303 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35658, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-07 10:54:32,311 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/22b66d2a75eb4fbdad58f03d6a3ca301 first=Optional[r3] last=Optional[r6] 2023-03-07 10:54:32,312 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/22b66d2a75eb4fbdad58f03d6a3ca301}] 2023-03-07 10:54:32,316 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/22b66d2a75eb4fbdad58f03d6a3ca301 for inclusion in e9afcd90942935584307bde41071b5e6/family1 2023-03-07 10:54:32,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-07 10:54:32,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(777): Region bounds: first= last= 2023-03-07 10:54:32,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for e9afcd90942935584307bde41071b5e6: 2023-03-07 10:54:32,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/22b66d2a75eb4fbdad58f03d6a3ca301 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__hai6vt436n043rdg48obn0urct0588s9n4b41o71oup13hdsomj36usavegle17/family1/22b66d2a75eb4fbdad58f03d6a3ca301 2023-03-07 10:54:32,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__hai6vt436n043rdg48obn0urct0588s9n4b41o71oup13hdsomj36usavegle17/family1/22b66d2a75eb4fbdad58f03d6a3ca301 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/e3af4946e7e84c21a7479389edb2dd03_SeqId_44_ 2023-03-07 10:54:32,321 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__hai6vt436n043rdg48obn0urct0588s9n4b41o71oup13hdsomj36usavegle17/family1/22b66d2a75eb4fbdad58f03d6a3ca301 into e9afcd90942935584307bde41071b5e6/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/e3af4946e7e84c21a7479389edb2dd03_SeqId_44_ - updating store file list. 2023-03-07 10:54:32,325 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/e3af4946e7e84c21a7479389edb2dd03_SeqId_44_ into e9afcd90942935584307bde41071b5e6/family1 2023-03-07 10:54:32,325 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__hai6vt436n043rdg48obn0urct0588s9n4b41o71oup13hdsomj36usavegle17/family1/22b66d2a75eb4fbdad58f03d6a3ca301 into e9afcd90942935584307bde41071b5e6/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/e3af4946e7e84c21a7479389edb2dd03_SeqId_44_) 2023-03-07 10:54:32,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__hai6vt436n043rdg48obn0urct0588s9n4b41o71oup13hdsomj36usavegle17/family1/22b66d2a75eb4fbdad58f03d6a3ca301 2023-03-07 10:54:32,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-07 10:54:32,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-07 10:54:32,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(1912): e9afcd90942935584307bde41071b5e6/family1 is initiating minor compaction 2023-03-07 10:54:32,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@14fa3ef; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:54:32,329 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e9afcd90942935584307bde41071b5e6/family1 in testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:32,329 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/57fcb68f23ab441e8cca01b18a974118, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/938daae57d4b4a12ae528430e5005473, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/4ec9d6b6ce66481f99632b3c52f3ead5, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/bfcc804c24ae4af8afc7ba5b505c3999, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/6b9f48fec48d429d85c9b56033682721, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/a3a318d84c4b4cd1a4f5d4c924f8a29e, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/87731a46bec3418b9b9e92295dbceab4, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/cbbbdfc8aa894180802918d988ae2750, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/f33f8433fc384b0e9f1815568579a863, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/e3af4946e7e84c21a7479389edb2dd03_SeqId_44_] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/.tmp, totalSize=50.0 K 2023-03-07 10:54:32,329 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 57fcb68f23ab441e8cca01b18a974118, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-07 10:54:32,329 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 938daae57d4b4a12ae528430e5005473, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-07 10:54:32,329 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 4ec9d6b6ce66481f99632b3c52f3ead5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-07 10:54:32,329 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting bfcc804c24ae4af8afc7ba5b505c3999, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-07 10:54:32,329 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 6b9f48fec48d429d85c9b56033682721, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-07 10:54:32,329 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting a3a318d84c4b4cd1a4f5d4c924f8a29e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-07 10:54:32,329 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 87731a46bec3418b9b9e92295dbceab4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-07 10:54:32,329 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting cbbbdfc8aa894180802918d988ae2750, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-07 10:54:32,329 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting f33f8433fc384b0e9f1815568579a863, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-07 10:54:32,329 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting e3af4946e7e84c21a7479389edb2dd03_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-07 10:54:32,330 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-07 10:54:32,331 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:54:32,333 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228f96c7c039c68448aa3f3dda12763d7d6 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228f96c7c039c68448aa3f3dda12763d7d6 2023-03-07 10:54:32,334 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231d6a410d654164662826bdedf87e8e081 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231d6a410d654164662826bdedf87e8e081 2023-03-07 10:54:32,335 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601017d94ef79683c44009f21fe342f132201 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601017d94ef79683c44009f21fe342f132201 2023-03-07 10:54:32,336 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601033d985b40e089428c9e0a6ee0887bcd31 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601033d985b40e089428c9e0a6ee0887bcd31 2023-03-07 10:54:32,337 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-03-07 10:54:32,337 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-07 10:54:32,337 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-07 10:54:32,337 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-07 10:54:32,337 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-07 10:54:32,337 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-07 10:54:32,337 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-07 10:54:32,337 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-07 10:54:32,337 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-07 10:54:32,337 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-07 10:54:32,376 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] throttle.PressureAwareThroughputController(145): e9afcd90942935584307bde41071b5e6#family1#compaction#49 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:54:33,193 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/.tmp/family1/606dce6151284be79addcadcd206fb6d as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/606dce6151284be79addcadcd206fb6d 2023-03-07 10:54:33,198 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in e9afcd90942935584307bde41071b5e6/family1 of e9afcd90942935584307bde41071b5e6 into 606dce6151284be79addcadcd206fb6d(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-07 10:54:33,198 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e9afcd90942935584307bde41071b5e6: 2023-03-07 10:54:33,198 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1678186472328; duration=0sec 2023-03-07 10:54:33,198 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:54:33,204 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f43d5396b02a47d3bc0893f148447801 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205f43d5396b02a47d3bc0893f148447801 2023-03-07 10:54:33,205 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-07 10:54:33,231 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9a20c1028ba34051822c86b8a5c601bc first=Optional[r00] last=Optional[r2] 2023-03-07 10:54:33,232 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9a20c1028ba34051822c86b8a5c601bc}] 2023-03-07 10:54:33,234 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9a20c1028ba34051822c86b8a5c601bc for inclusion in e9afcd90942935584307bde41071b5e6/family1 2023-03-07 10:54:33,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-07 10:54:33,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(777): Region bounds: first= last= 2023-03-07 10:54:33,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for e9afcd90942935584307bde41071b5e6: 2023-03-07 10:54:33,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9a20c1028ba34051822c86b8a5c601bc to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__n35nb9t8rd1nbf4eat0iaasle3rs44k3r4628j3ol655epg8o1hjlds06pk8bbtf/family1/9a20c1028ba34051822c86b8a5c601bc 2023-03-07 10:54:33,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__n35nb9t8rd1nbf4eat0iaasle3rs44k3r4628j3ol655epg8o1hjlds06pk8bbtf/family1/9a20c1028ba34051822c86b8a5c601bc as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/0f4b3df6a54c47e98176f7ada18d5ac6_SeqId_47_ 2023-03-07 10:54:33,240 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__n35nb9t8rd1nbf4eat0iaasle3rs44k3r4628j3ol655epg8o1hjlds06pk8bbtf/family1/9a20c1028ba34051822c86b8a5c601bc into e9afcd90942935584307bde41071b5e6/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/0f4b3df6a54c47e98176f7ada18d5ac6_SeqId_47_ - updating store file list. 2023-03-07 10:54:33,244 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/0f4b3df6a54c47e98176f7ada18d5ac6_SeqId_47_ into e9afcd90942935584307bde41071b5e6/family1 2023-03-07 10:54:33,244 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__n35nb9t8rd1nbf4eat0iaasle3rs44k3r4628j3ol655epg8o1hjlds06pk8bbtf/family1/9a20c1028ba34051822c86b8a5c601bc into e9afcd90942935584307bde41071b5e6/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/0f4b3df6a54c47e98176f7ada18d5ac6_SeqId_47_) 2023-03-07 10:54:33,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__n35nb9t8rd1nbf4eat0iaasle3rs44k3r4628j3ol655epg8o1hjlds06pk8bbtf/family1/9a20c1028ba34051822c86b8a5c601bc 2023-03-07 10:54:33,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-07 10:54:33,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-07 10:54:33,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(1912): e9afcd90942935584307bde41071b5e6/family1 is initiating minor compaction (all files) 2023-03-07 10:54:33,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@729f1242; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:54:33,245 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e9afcd90942935584307bde41071b5e6/family1 in testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:54:33,245 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/8b672d97d1d74f8c9bb561e8d62c80c7, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/606dce6151284be79addcadcd206fb6d, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/0f4b3df6a54c47e98176f7ada18d5ac6_SeqId_47_] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/.tmp, totalSize=337.0 K 2023-03-07 10:54:33,246 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 8b672d97d1d74f8c9bb561e8d62c80c7, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878838856 2023-03-07 10:54:33,246 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 606dce6151284be79addcadcd206fb6d, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621238856 2023-03-07 10:54:33,247 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 0f4b3df6a54c47e98176f7ada18d5ac6_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878838856 2023-03-07 10:54:33,247 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-07 10:54:33,248 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:54:33,249 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511304dd4a10330444df1bd45a1329e08658c to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511304dd4a10330444df1bd45a1329e08658c 2023-03-07 10:54:33,251 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201eb0d9adbc1824d14831ff2af153c6845 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201eb0d9adbc1824d14831ff2af153c6845 2023-03-07 10:54:33,252 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205d6798187c7a54d408b8aa7741d909ca1 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205d6798187c7a54d408b8aa7741d909ca1 2023-03-07 10:54:33,252 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-03-07 10:54:33,252 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-07 10:54:33,253 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-07 10:54:33,253 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-07 10:54:33,253 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:54:33,254 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-07 10:54:33,256 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8250 sec 2023-03-07 10:54:33,264 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] throttle.PressureAwareThroughputController(145): e9afcd90942935584307bde41071b5e6#family1#compaction#50 average throughput is 17.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:54:33,282 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/57fcb68f23ab441e8cca01b18a974118, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/938daae57d4b4a12ae528430e5005473, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/4ec9d6b6ce66481f99632b3c52f3ead5, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/bfcc804c24ae4af8afc7ba5b505c3999, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/6b9f48fec48d429d85c9b56033682721, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/a3a318d84c4b4cd1a4f5d4c924f8a29e, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/87731a46bec3418b9b9e92295dbceab4, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/cbbbdfc8aa894180802918d988ae2750, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/f33f8433fc384b0e9f1815568579a863, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/e3af4946e7e84c21a7479389edb2dd03_SeqId_44_] to archive 2023-03-07 10:54:33,284 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:54:33,286 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/57fcb68f23ab441e8cca01b18a974118 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/57fcb68f23ab441e8cca01b18a974118 2023-03-07 10:54:33,288 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/938daae57d4b4a12ae528430e5005473 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/938daae57d4b4a12ae528430e5005473 2023-03-07 10:54:33,290 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/4ec9d6b6ce66481f99632b3c52f3ead5 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/4ec9d6b6ce66481f99632b3c52f3ead5 2023-03-07 10:54:33,291 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/bfcc804c24ae4af8afc7ba5b505c3999 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/bfcc804c24ae4af8afc7ba5b505c3999 2023-03-07 10:54:33,292 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/6b9f48fec48d429d85c9b56033682721 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/6b9f48fec48d429d85c9b56033682721 2023-03-07 10:54:33,294 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/a3a318d84c4b4cd1a4f5d4c924f8a29e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/a3a318d84c4b4cd1a4f5d4c924f8a29e 2023-03-07 10:54:33,295 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/87731a46bec3418b9b9e92295dbceab4 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/87731a46bec3418b9b9e92295dbceab4 2023-03-07 10:54:33,297 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/cbbbdfc8aa894180802918d988ae2750 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/cbbbdfc8aa894180802918d988ae2750 2023-03-07 10:54:33,299 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/f33f8433fc384b0e9f1815568579a863 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/f33f8433fc384b0e9f1815568579a863 2023-03-07 10:54:33,301 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/e3af4946e7e84c21a7479389edb2dd03_SeqId_44_ to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/e3af4946e7e84c21a7479389edb2dd03_SeqId_44_ 2023-03-07 10:54:33,316 DEBUG [hfile_cleaner-dir-scan-pool-1] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 17 more 2023-03-07 10:54:33,384 INFO [Listener at localhost/42383] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=263 (was 250) - Thread LEAK? -, OpenFileDescriptor=627 (was 589) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=235 (was 260), ProcessCount=171 (was 171), AvailableMemoryMB=9548 (was 9419) - AvailableMemoryMB LEAK? - 2023-03-07 10:54:33,399 INFO [Listener at localhost/42383] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=263, OpenFileDescriptor=627, MaxFileDescriptor=60000, SystemLoadAverage=235, ProcessCount=171, AvailableMemoryMB=9547 2023-03-07 10:54:33,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-07 10:54:33,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:33,404 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-03-07 10:54:33,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-03-07 10:54:33,404 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-07 10:54:33,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-07 10:54:33,406 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30 2023-03-07 10:54:33,406 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30 empty. 2023-03-07 10:54:33,407 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30 2023-03-07 10:54:33,407 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-03-07 10:54:33,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-07 10:54:33,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-07 10:54:33,817 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-03-07 10:54:33,818 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 27a4c8afde515956994670de0df3cf30, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp 2023-03-07 10:54:34,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-07 10:54:34,224 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:54:34,224 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing 27a4c8afde515956994670de0df3cf30, disabling compactions & flushes 2023-03-07 10:54:34,224 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:34,224 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:34,224 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. after waiting 0 ms 2023-03-07 10:54:34,225 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:34,225 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:34,225 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for 27a4c8afde515956994670de0df3cf30: 2023-03-07 10:54:34,228 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-03-07 10:54:34,229 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678186474228"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186474228"}]},"ts":"1678186474228"} 2023-03-07 10:54:34,230 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-07 10:54:34,231 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-07 10:54:34,231 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186474231"}]},"ts":"1678186474231"} 2023-03-07 10:54:34,232 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-03-07 10:54:34,235 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=27a4c8afde515956994670de0df3cf30, ASSIGN}] 2023-03-07 10:54:34,236 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=27a4c8afde515956994670de0df3cf30, ASSIGN 2023-03-07 10:54:34,237 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=27a4c8afde515956994670de0df3cf30, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39673,1678186416064; forceNewPlan=false, retain=false 2023-03-07 10:54:34,388 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=27a4c8afde515956994670de0df3cf30, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:34,388 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678186474388"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186474388"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186474388"}]},"ts":"1678186474388"} 2023-03-07 10:54:34,390 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 27a4c8afde515956994670de0df3cf30, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:54:34,498 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/.tmp/family1/d76001bec03f4f93b23d70e312c904df as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/d76001bec03f4f93b23d70e312c904df 2023-03-07 10:54:34,503 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e9afcd90942935584307bde41071b5e6/family1 of e9afcd90942935584307bde41071b5e6 into d76001bec03f4f93b23d70e312c904df(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-07 10:54:34,503 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e9afcd90942935584307bde41071b5e6: 2023-03-07 10:54:34,503 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1678186473245; duration=1sec 2023-03-07 10:54:34,503 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:54:34,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-07 10:54:34,545 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:34,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 27a4c8afde515956994670de0df3cf30, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30.', STARTKEY => '', ENDKEY => ''} 2023-03-07 10:54:34,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 27a4c8afde515956994670de0df3cf30 2023-03-07 10:54:34,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:54:34,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 27a4c8afde515956994670de0df3cf30 2023-03-07 10:54:34,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 27a4c8afde515956994670de0df3cf30 2023-03-07 10:54:34,547 INFO [StoreOpener-27a4c8afde515956994670de0df3cf30-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 27a4c8afde515956994670de0df3cf30 2023-03-07 10:54:34,548 DEBUG [StoreOpener-27a4c8afde515956994670de0df3cf30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1 2023-03-07 10:54:34,548 DEBUG [StoreOpener-27a4c8afde515956994670de0df3cf30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1 2023-03-07 10:54:34,549 INFO [StoreOpener-27a4c8afde515956994670de0df3cf30-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 27a4c8afde515956994670de0df3cf30 columnFamilyName family1 2023-03-07 10:54:34,550 INFO [StoreOpener-27a4c8afde515956994670de0df3cf30-1] regionserver.HStore(310): Store=27a4c8afde515956994670de0df3cf30/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:54:34,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30 2023-03-07 10:54:34,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30 2023-03-07 10:54:34,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 27a4c8afde515956994670de0df3cf30 2023-03-07 10:54:34,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-07 10:54:34,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 27a4c8afde515956994670de0df3cf30; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69943173, jitterRate=0.04223449528217316}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-07 10:54:34,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 27a4c8afde515956994670de0df3cf30: 2023-03-07 10:54:34,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30., pid=41, masterSystemTime=1678186474542 2023-03-07 10:54:34,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:34,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:34,558 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=27a4c8afde515956994670de0df3cf30, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:34,559 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678186474558"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186474558"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186474558"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186474558"}]},"ts":"1678186474558"} 2023-03-07 10:54:34,562 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-03-07 10:54:34,562 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 27a4c8afde515956994670de0df3cf30, server=jenkins-hbase4.apache.org,39673,1678186416064 in 170 msec 2023-03-07 10:54:34,563 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-03-07 10:54:34,563 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=27a4c8afde515956994670de0df3cf30, ASSIGN in 327 msec 2023-03-07 10:54:34,564 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-07 10:54:34,564 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186474564"}]},"ts":"1678186474564"} 2023-03-07 10:54:34,565 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-03-07 10:54:34,569 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/8b672d97d1d74f8c9bb561e8d62c80c7, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/606dce6151284be79addcadcd206fb6d, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/0f4b3df6a54c47e98176f7ada18d5ac6_SeqId_47_] to archive 2023-03-07 10:54:34,570 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:54:34,570 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-03-07 10:54:34,571 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1690 sec 2023-03-07 10:54:34,571 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/8b672d97d1d74f8c9bb561e8d62c80c7 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/8b672d97d1d74f8c9bb561e8d62c80c7 2023-03-07 10:54:34,572 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/606dce6151284be79addcadcd206fb6d to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/606dce6151284be79addcadcd206fb6d 2023-03-07 10:54:34,573 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/0f4b3df6a54c47e98176f7ada18d5ac6_SeqId_47_ to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/family1/0f4b3df6a54c47e98176f7ada18d5ac6_SeqId_47_ 2023-03-07 10:54:35,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-07 10:54:35,511 INFO [Listener at localhost/42383] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-03-07 10:54:35,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:35,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:35,530 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-07 10:54:35,530 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:35,530 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-07 10:54:35,530 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-07 10:54:35,531 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:35,531 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:35,532 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:35,532 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:35,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:35,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:35,532 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:35,532 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:35,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:35,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:35,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:35,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:35,533 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:35,533 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:35,533 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-07 10:54:35,533 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:35,533 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-07 10:54:35,533 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:35,534 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:35,534 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:35,534 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. started... 2023-03-07 10:54:35,534 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27a4c8afde515956994670de0df3cf30 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-07 10:54:35,958 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113032ce4261516f46cc81ec4c16b62e0d47 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113032ce4261516f46cc81ec4c16b62e0d47 2023-03-07 10:54:36,362 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/.tmp/family1/8060b1ef2c8044a29edcb5867036859d 2023-03-07 10:54:36,368 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/.tmp/family1/8060b1ef2c8044a29edcb5867036859d as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/8060b1ef2c8044a29edcb5867036859d 2023-03-07 10:54:36,372 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/8060b1ef2c8044a29edcb5867036859d, entries=1000, sequenceid=5, filesize=191.4 K 2023-03-07 10:54:36,373 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 27a4c8afde515956994670de0df3cf30 in 839ms, sequenceid=5, compaction requested=false 2023-03-07 10:54:36,373 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-07 10:54:36,373 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27a4c8afde515956994670de0df3cf30: 2023-03-07 10:54:36,374 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:36,374 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:36,374 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:36,374 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:36,374 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-07 10:54:36,374 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-07 10:54:36,375 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:36,375 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:36,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:36,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:36,376 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,376 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:36,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:36,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:36,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:36,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:36,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-07 10:54:36,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56e43412[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:36,377 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-07 10:54:36,378 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,379 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,379 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-07 10:54:36,379 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-07 10:54:36,379 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:36,379 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:36,379 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:36,381 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-07 10:54:36,381 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:36,381 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:36,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:36,381 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-07 10:54:36,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:36,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:36,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:36,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:36,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:36,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:36,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:36,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:36,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-07 10:54:36,384 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-07 10:54:36,384 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:36,384 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:36,384 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,384 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:36,385 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,385 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:36,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:36,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,385 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:36,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,386 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:36,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:36,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:36,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:36,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:36,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,387 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:36,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:36,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:36,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:36,389 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:36,389 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:36,389 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,390 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:36,390 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-07 10:54:36,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:36,390 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:36,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:36,390 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-07 10:54:36,390 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:36,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:36,390 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:36,390 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,390 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:36,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:36,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:36,390 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,390 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,490 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:36,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:36,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:36,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:36,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,497 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-07 10:54:36,497 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:36,497 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-07 10:54:36,497 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-07 10:54:36,498 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,498 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,499 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:36,499 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:36,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:36,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:36,499 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:36,499 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:36,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,500 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:36,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,500 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,500 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-07 10:54:36,500 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:36,500 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-07 10:54:36,500 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:36,501 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-07 10:54:36,501 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:36,501 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:36,501 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:36,501 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. started... 2023-03-07 10:54:36,501 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27a4c8afde515956994670de0df3cf30 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-07 10:54:36,914 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511287fc0847e3fd7426e87a0bd9388836455 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511287fc0847e3fd7426e87a0bd9388836455 2023-03-07 10:54:37,321 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/.tmp/family1/4b21cfcbe0e74324b7ca9cf06ef655be 2023-03-07 10:54:37,327 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/.tmp/family1/4b21cfcbe0e74324b7ca9cf06ef655be as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/4b21cfcbe0e74324b7ca9cf06ef655be 2023-03-07 10:54:37,332 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/4b21cfcbe0e74324b7ca9cf06ef655be, entries=1, sequenceid=9, filesize=5.0 K 2023-03-07 10:54:37,333 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 27a4c8afde515956994670de0df3cf30 in 832ms, sequenceid=9, compaction requested=false 2023-03-07 10:54:37,333 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27a4c8afde515956994670de0df3cf30: 2023-03-07 10:54:37,333 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:37,333 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:37,333 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:37,333 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:37,333 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-07 10:54:37,333 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-07 10:54:37,335 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:37,335 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:37,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:37,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:37,335 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,335 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:37,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:37,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:37,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:37,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:37,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-07 10:54:37,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37b30cd9[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:37,336 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-07 10:54:37,336 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,337 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,338 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-07 10:54:37,338 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:37,338 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:37,338 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-07 10:54:37,338 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:37,339 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-07 10:54:37,339 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:37,339 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:37,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:37,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:37,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:37,339 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-07 10:54:37,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:37,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:37,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:37,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:37,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:37,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:37,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-07 10:54:37,341 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-07 10:54:37,342 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:37,342 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:37,342 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,342 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:37,344 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,344 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:37,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:37,344 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:37,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,345 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:37,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:37,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:37,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:37,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:37,346 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:37,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:37,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:37,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:37,351 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:37,351 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,351 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:37,351 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:37,351 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:37,351 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,351 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,351 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-07 10:54:37,351 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-07 10:54:37,351 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:37,351 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:37,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:37,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:37,352 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:37,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:37,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:37,352 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:37,358 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-07 10:54:37,452 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:37,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:37,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:37,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:37,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,459 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-07 10:54:37,459 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:37,459 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-07 10:54:37,459 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-07 10:54:37,460 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,460 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,462 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:37,462 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:37,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:37,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:37,462 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:37,462 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:37,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,462 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:37,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,463 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,463 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-07 10:54:37,463 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:37,463 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-07 10:54:37,463 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:37,463 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-07 10:54:37,463 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:37,463 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:37,463 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:37,463 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. started... 2023-03-07 10:54:37,464 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27a4c8afde515956994670de0df3cf30 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:37,876 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120168d1bb78f09c43bcacb8f41e977de03e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120168d1bb78f09c43bcacb8f41e977de03e 2023-03-07 10:54:38,281 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/.tmp/family1/0a6e6a49b65d43569719bebf41f4d1cd 2023-03-07 10:54:38,286 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/.tmp/family1/0a6e6a49b65d43569719bebf41f4d1cd as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/0a6e6a49b65d43569719bebf41f4d1cd 2023-03-07 10:54:38,290 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/0a6e6a49b65d43569719bebf41f4d1cd, entries=1, sequenceid=13, filesize=5.0 K 2023-03-07 10:54:38,290 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 27a4c8afde515956994670de0df3cf30 in 827ms, sequenceid=13, compaction requested=true 2023-03-07 10:54:38,290 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27a4c8afde515956994670de0df3cf30: 2023-03-07 10:54:38,290 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:38,291 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:38,291 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:38,291 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:38,291 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-07 10:54:38,291 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-07 10:54:38,292 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:38,292 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:38,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:38,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:38,293 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,293 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:38,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:38,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:38,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:38,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:38,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-07 10:54:38,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@89f0db3[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:38,294 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-07 10:54:38,294 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,295 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,296 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-07 10:54:38,296 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-07 10:54:38,296 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:38,296 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:38,296 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:38,298 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-07 10:54:38,298 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:38,298 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:38,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:38,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:38,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:38,299 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-07 10:54:38,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:38,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:38,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:38,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:38,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:38,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:38,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-07 10:54:38,301 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-07 10:54:38,301 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:38,301 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:38,301 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,301 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:38,303 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,303 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,303 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:38,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:38,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:38,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:38,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:38,303 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:38,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:38,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:38,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,305 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:38,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:38,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:38,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:38,307 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:38,307 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:38,307 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:38,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:38,307 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:38,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-07 10:54:38,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-07 10:54:38,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:38,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:38,307 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,307 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,307 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:38,307 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:38,307 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,308 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:38,308 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:38,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:38,308 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,408 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:38,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:38,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:38,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:38,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,415 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-07 10:54:38,415 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:38,415 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-07 10:54:38,415 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-07 10:54:38,415 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,415 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,417 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:38,417 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:38,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:38,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:38,417 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:38,417 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:38,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,417 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:38,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,418 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,418 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-07 10:54:38,418 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:38,418 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-07 10:54:38,418 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:38,418 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-07 10:54:38,418 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:38,418 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:38,418 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:38,418 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. started... 2023-03-07 10:54:38,419 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27a4c8afde515956994670de0df3cf30 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:38,832 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120503369e35222d44cfbbb799c65e3cea2b to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120503369e35222d44cfbbb799c65e3cea2b 2023-03-07 10:54:39,238 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/.tmp/family1/70482b6431bd45f9a992f99d48d71ec4 2023-03-07 10:54:39,242 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/.tmp/family1/70482b6431bd45f9a992f99d48d71ec4 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/70482b6431bd45f9a992f99d48d71ec4 2023-03-07 10:54:39,247 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/70482b6431bd45f9a992f99d48d71ec4, entries=1, sequenceid=17, filesize=5.0 K 2023-03-07 10:54:39,247 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 27a4c8afde515956994670de0df3cf30 in 828ms, sequenceid=17, compaction requested=true 2023-03-07 10:54:39,248 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27a4c8afde515956994670de0df3cf30: 2023-03-07 10:54:39,248 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:39,248 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:39,248 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:39,248 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:39,248 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-07 10:54:39,248 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-07 10:54:39,252 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:39,252 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:39,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:39,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:39,252 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,252 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:39,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:39,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:39,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:39,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:39,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-07 10:54:39,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b93b3b[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:39,253 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-07 10:54:39,254 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,255 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,255 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-07 10:54:39,255 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-07 10:54:39,255 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:39,256 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:39,256 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:39,256 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:39,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:39,257 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-07 10:54:39,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:39,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:39,257 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:39,257 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-07 10:54:39,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:39,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:39,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:39,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:39,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:39,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:39,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-07 10:54:39,259 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-07 10:54:39,259 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:39,259 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:39,259 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,259 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:39,261 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,261 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,261 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:39,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:39,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:39,261 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:39,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:39,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:39,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:39,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:39,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,262 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:39,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:39,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:39,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:39,265 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:39,265 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:39,265 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,265 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,265 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:39,266 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:39,266 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,266 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,266 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:39,266 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-07 10:54:39,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-07 10:54:39,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:39,266 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,266 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:39,266 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:39,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:39,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:39,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:39,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:39,366 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:39,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:39,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:39,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:39,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,373 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-07 10:54:39,373 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:39,373 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-07 10:54:39,373 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-07 10:54:39,374 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,374 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,375 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:39,375 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:39,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:39,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:39,375 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:39,375 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:39,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:39,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,377 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,377 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-07 10:54:39,377 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:39,377 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-07 10:54:39,377 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:39,377 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-07 10:54:39,377 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:39,377 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:39,377 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:39,377 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. started... 2023-03-07 10:54:39,378 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27a4c8afde515956994670de0df3cf30 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:39,791 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122812d14da0754b44a6bac2f6b47b07cd76 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122812d14da0754b44a6bac2f6b47b07cd76 2023-03-07 10:54:40,080 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-07 10:54:40,197 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/.tmp/family1/b647d5e6041f4fd4b2953bb916efbb22 2023-03-07 10:54:40,201 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/.tmp/family1/b647d5e6041f4fd4b2953bb916efbb22 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/b647d5e6041f4fd4b2953bb916efbb22 2023-03-07 10:54:40,205 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/b647d5e6041f4fd4b2953bb916efbb22, entries=1, sequenceid=21, filesize=5.0 K 2023-03-07 10:54:40,206 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 27a4c8afde515956994670de0df3cf30 in 828ms, sequenceid=21, compaction requested=true 2023-03-07 10:54:40,206 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27a4c8afde515956994670de0df3cf30: 2023-03-07 10:54:40,206 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:40,206 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:40,206 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:40,206 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:40,206 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-07 10:54:40,206 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-07 10:54:40,210 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:40,210 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:40,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:40,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:40,210 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,210 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:40,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:40,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:40,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:40,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:40,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-07 10:54:40,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@778acb9a[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:40,211 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-07 10:54:40,211 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,212 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,213 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-07 10:54:40,213 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:40,213 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:40,213 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-07 10:54:40,213 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:40,214 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-07 10:54:40,214 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:40,214 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:40,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:40,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:40,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:40,214 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-07 10:54:40,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:40,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:40,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:40,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:40,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:40,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:40,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-07 10:54:40,216 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-07 10:54:40,216 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:40,216 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:40,216 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,216 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:40,219 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,219 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,219 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:40,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:40,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:40,220 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:40,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:40,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:40,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:40,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:40,221 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:40,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:40,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:40,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:40,223 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:40,223 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,223 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,223 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:40,223 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:40,223 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:40,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:40,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-07 10:54:40,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:40,223 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:40,223 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:40,223 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,223 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,223 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-07 10:54:40,224 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:40,224 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:40,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:40,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:40,324 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:40,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:40,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:40,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:40,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,331 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-07 10:54:40,331 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:40,331 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-07 10:54:40,331 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-07 10:54:40,331 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,331 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,332 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:40,332 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:40,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:40,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:40,333 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:40,333 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:40,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,333 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:40,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,334 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,340 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-07 10:54:40,340 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:40,340 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-07 10:54:40,340 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:40,340 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-07 10:54:40,340 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:40,340 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:40,340 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:40,340 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. started... 2023-03-07 10:54:40,341 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27a4c8afde515956994670de0df3cf30 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:40,759 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123192df3fe9fc494901a3fabf15c9308c53 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123192df3fe9fc494901a3fabf15c9308c53 2023-03-07 10:54:41,177 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/.tmp/family1/506fbd7f875c45fb996473bc40e2f3cf 2023-03-07 10:54:41,182 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/.tmp/family1/506fbd7f875c45fb996473bc40e2f3cf as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/506fbd7f875c45fb996473bc40e2f3cf 2023-03-07 10:54:41,187 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/506fbd7f875c45fb996473bc40e2f3cf, entries=1, sequenceid=25, filesize=5.0 K 2023-03-07 10:54:41,188 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 27a4c8afde515956994670de0df3cf30 in 848ms, sequenceid=25, compaction requested=true 2023-03-07 10:54:41,188 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27a4c8afde515956994670de0df3cf30: 2023-03-07 10:54:41,188 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:41,188 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:41,188 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:41,188 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:41,188 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-07 10:54:41,188 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-07 10:54:41,190 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,190 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:41,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:41,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:41,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:41,190 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,190 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:41,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:41,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:41,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:41,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:41,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-07 10:54:41,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58f0c476[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:41,192 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-07 10:54:41,192 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,199 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,199 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-07 10:54:41,199 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:41,199 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:41,199 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-07 10:54:41,199 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:41,200 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-07 10:54:41,200 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:41,200 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:41,200 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-07 10:54:41,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:41,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:41,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:41,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:41,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:41,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:41,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:41,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:41,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:41,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-07 10:54:41,202 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-07 10:54:41,202 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:41,202 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:41,202 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,202 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:41,204 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,204 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:41,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:41,204 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:41,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,204 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:41,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:41,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:41,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:41,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:41,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,205 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:41,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:41,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:41,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:41,207 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:41,207 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:41,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:41,207 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:41,207 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:41,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-07 10:54:41,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:41,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:41,207 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,208 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,208 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:41,208 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-07 10:54:41,208 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,208 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:41,208 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:41,208 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:41,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:41,208 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,308 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:41,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:41,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:41,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:41,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,315 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-07 10:54:41,315 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:41,315 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-07 10:54:41,315 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-07 10:54:41,315 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,316 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,317 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:41,317 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:41,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:41,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:41,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,318 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:41,318 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:41,318 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:41,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,318 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,319 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-07 10:54:41,319 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:41,319 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-07 10:54:41,319 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:41,319 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-07 10:54:41,319 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:41,319 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:41,319 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:41,319 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. started... 2023-03-07 10:54:41,319 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27a4c8afde515956994670de0df3cf30 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:41,734 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101e3fc1c213e3b42bfab1472a2be5fd77b to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101e3fc1c213e3b42bfab1472a2be5fd77b 2023-03-07 10:54:42,139 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/.tmp/family1/173a7de702ce46bf81ac670e1b689f49 2023-03-07 10:54:42,144 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/.tmp/family1/173a7de702ce46bf81ac670e1b689f49 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/173a7de702ce46bf81ac670e1b689f49 2023-03-07 10:54:42,148 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/173a7de702ce46bf81ac670e1b689f49, entries=1, sequenceid=29, filesize=5.0 K 2023-03-07 10:54:42,149 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 27a4c8afde515956994670de0df3cf30 in 830ms, sequenceid=29, compaction requested=true 2023-03-07 10:54:42,149 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27a4c8afde515956994670de0df3cf30: 2023-03-07 10:54:42,149 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:42,149 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:42,149 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:42,149 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,149 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-07 10:54:42,149 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-07 10:54:42,151 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,151 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:42,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:42,151 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,151 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:42,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:42,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:42,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:42,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-07 10:54:42,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28f2a84e[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:42,152 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-07 10:54:42,152 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,154 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,154 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-07 10:54:42,154 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-07 10:54:42,154 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:42,154 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,154 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:42,155 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-07 10:54:42,155 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,155 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:42,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:42,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:42,155 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-07 10:54:42,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:42,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:42,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:42,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:42,157 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-07 10:54:42,157 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-07 10:54:42,157 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:42,157 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:42,157 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,157 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:42,164 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,164 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:42,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:42,164 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:42,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:42,165 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:42,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:42,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:42,166 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:42,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,168 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,168 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,168 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:42,168 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:42,168 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-07 10:54:42,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:42,168 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-07 10:54:42,168 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:42,168 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:42,168 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:42,169 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:42,169 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:42,169 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,169 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:42,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:42,269 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:42,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:42,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:42,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:42,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,276 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-07 10:54:42,276 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:42,276 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-07 10:54:42,276 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-07 10:54:42,276 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,276 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,277 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,277 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:42,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:42,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:42,277 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,278 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:42,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,278 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:42,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,278 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,278 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-07 10:54:42,279 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,279 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-07 10:54:42,279 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:42,279 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-07 10:54:42,279 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:42,279 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:42,279 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:42,279 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. started... 2023-03-07 10:54:42,279 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27a4c8afde515956994670de0df3cf30 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:42,291 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103d9314bb1efe64f4eb144f8d07f7c446a to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103d9314bb1efe64f4eb144f8d07f7c446a 2023-03-07 10:54:42,696 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/.tmp/family1/245aa7604c44442c8c25da46d4ff6c98 2023-03-07 10:54:42,700 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/.tmp/family1/245aa7604c44442c8c25da46d4ff6c98 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/245aa7604c44442c8c25da46d4ff6c98 2023-03-07 10:54:42,704 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/245aa7604c44442c8c25da46d4ff6c98, entries=1, sequenceid=33, filesize=5.0 K 2023-03-07 10:54:42,705 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 27a4c8afde515956994670de0df3cf30 in 426ms, sequenceid=33, compaction requested=true 2023-03-07 10:54:42,705 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27a4c8afde515956994670de0df3cf30: 2023-03-07 10:54:42,705 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:42,706 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:42,706 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:42,706 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,706 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-07 10:54:42,706 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-07 10:54:42,708 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,708 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:42,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:42,708 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,708 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:42,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:42,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:42,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:42,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-07 10:54:42,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61db3e88[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:42,710 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-07 10:54:42,710 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,711 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,711 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-07 10:54:42,711 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-07 10:54:42,711 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:42,711 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,711 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:42,713 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-07 10:54:42,713 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:42,713 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,713 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-07 10:54:42,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:42,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:42,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:42,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:42,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:42,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:42,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-07 10:54:42,715 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-07 10:54:42,715 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:42,715 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:42,715 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,715 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:42,717 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,717 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:42,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:42,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,717 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:42,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:42,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:42,718 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:42,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:42,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,719 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:42,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,722 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:42,722 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:42,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:42,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-07 10:54:42,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:42,722 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:42,722 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:42,722 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:42,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:42,723 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,723 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:42,723 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,723 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:42,723 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,723 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,723 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,823 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:42,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:42,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:42,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:42,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,829 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-07 10:54:42,829 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:42,829 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-07 10:54:42,829 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-07 10:54:42,830 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,830 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,831 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,831 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:42,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:42,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:42,831 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:42,831 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:42,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,832 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:42,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,832 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,832 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-07 10:54:42,832 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:42,832 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-07 10:54:42,832 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:42,832 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-07 10:54:42,833 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:42,833 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:42,833 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:42,833 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. started... 2023-03-07 10:54:42,833 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27a4c8afde515956994670de0df3cf30 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:43,245 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509076ad655865ec24ec19da754908ee587fb to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201509076ad655865ec24ec19da754908ee587fb 2023-03-07 10:54:43,651 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/.tmp/family1/81ac25f09fdb4022929342dbc85bbb80 2023-03-07 10:54:43,656 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/.tmp/family1/81ac25f09fdb4022929342dbc85bbb80 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/81ac25f09fdb4022929342dbc85bbb80 2023-03-07 10:54:43,660 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/81ac25f09fdb4022929342dbc85bbb80, entries=1, sequenceid=37, filesize=5.0 K 2023-03-07 10:54:43,660 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 27a4c8afde515956994670de0df3cf30 in 827ms, sequenceid=37, compaction requested=true 2023-03-07 10:54:43,660 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27a4c8afde515956994670de0df3cf30: 2023-03-07 10:54:43,661 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:43,661 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:43,661 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:43,661 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:43,661 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-07 10:54:43,661 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-07 10:54:43,662 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:43,662 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:43,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:43,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:43,663 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,663 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:43,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:43,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:43,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:43,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:43,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-07 10:54:43,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40acef32[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:43,664 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-07 10:54:43,664 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,665 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,665 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-07 10:54:43,665 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-07 10:54:43,665 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:43,665 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:43,665 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:43,668 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-07 10:54:43,668 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:43,668 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:43,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:43,668 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-07 10:54:43,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:43,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:43,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:43,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:43,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:43,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:43,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:43,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:43,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-07 10:54:43,670 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-07 10:54:43,670 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:43,670 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:43,670 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,670 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:43,671 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,672 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:43,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:43,672 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:43,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:43,672 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:43,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:43,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:43,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:43,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,673 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:43,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:43,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:43,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:43,677 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:43,677 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:43,677 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:43,677 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:43,677 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:43,678 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:43,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-07 10:54:43,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:43,677 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:43,678 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,678 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,678 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,678 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:43,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:43,678 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:43,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:43,778 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:43,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:43,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:43,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:43,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,785 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-07 10:54:43,785 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:43,785 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-07 10:54:43,785 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-07 10:54:43,786 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,786 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,787 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:43,787 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:43,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:43,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:43,788 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:43,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,788 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:43,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:43,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,789 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,789 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-07 10:54:43,789 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:43,789 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-07 10:54:43,789 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:43,789 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-07 10:54:43,795 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:43,795 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:43,795 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:43,795 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. started... 2023-03-07 10:54:43,795 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27a4c8afde515956994670de0df3cf30 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:44,211 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511205a14d6692a0742a4852ba2b7fc26bfef to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511205a14d6692a0742a4852ba2b7fc26bfef 2023-03-07 10:54:44,617 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/.tmp/family1/25b6e20b72d2499b929dca92fa640975 2023-03-07 10:54:44,622 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/.tmp/family1/25b6e20b72d2499b929dca92fa640975 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/25b6e20b72d2499b929dca92fa640975 2023-03-07 10:54:44,625 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/25b6e20b72d2499b929dca92fa640975, entries=1, sequenceid=41, filesize=5.0 K 2023-03-07 10:54:44,626 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 27a4c8afde515956994670de0df3cf30 in 831ms, sequenceid=41, compaction requested=true 2023-03-07 10:54:44,626 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27a4c8afde515956994670de0df3cf30: 2023-03-07 10:54:44,626 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:44,626 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:44,626 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:44,626 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:44,626 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-07 10:54:44,626 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-07 10:54:44,628 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:44,628 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:44,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:44,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:44,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:44,628 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:44,628 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:44,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:44,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:44,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:44,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:44,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:44,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-07 10:54:44,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ea14025[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:44,630 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-07 10:54:44,630 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:44,632 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:44,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:44,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:44,632 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-07 10:54:44,632 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-07 10:54:44,632 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:44,632 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:44,632 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:44,633 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:44,633 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-07 10:54:44,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:44,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:44,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:44,633 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:44,633 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-07 10:54:44,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:44,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:44,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:44,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:44,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:44,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:44,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:44,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:44,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-07 10:54:44,635 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-07 10:54:44,635 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:44,635 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:44,635 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:44,635 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:44,637 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:44,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:44,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:44,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:44,637 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:44,637 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:44,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:44,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:44,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:44,637 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:44,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:44,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:44,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:44,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:44,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:44,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:44,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:44,639 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:44,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:44,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:44,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:44,641 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:44,641 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:44,641 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:44,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:44,641 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:44,641 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:44,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-07 10:54:44,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:44,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:44,641 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:44,641 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:44,641 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:44,642 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:44,642 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:44,642 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:44,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:44,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:44,642 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:44,742 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:44,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:44,744 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45579] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:44,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-07 10:54:44,746 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-07 10:54:44,747 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678187084747 2023-03-07 10:54:44,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:54:44,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-07 10:54:44,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-07 10:54:44,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-07 10:54:44,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] zookeeper.ReadOnlyZKClient(139): Connect 0x1869b4df to 127.0.0.1:56055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-07 10:54:44,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68acde79, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-07 10:54:44,756 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-07 10:54:45,599 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601036534d991aa6a4eaa9caab61749aa0d44 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601036534d991aa6a4eaa9caab61749aa0d44 2023-03-07 10:54:45,600 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-07 10:54:45,612 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-07 10:54:45,613 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58876, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-07 10:54:45,619 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-07 10:54:45,621 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46580, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-07 10:54:45,639 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bf5c8eb522f047cd8da62bf0b14e9e38 first=Optional[r3] last=Optional[r6] 2023-03-07 10:54:45,640 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bf5c8eb522f047cd8da62bf0b14e9e38}] 2023-03-07 10:54:45,644 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bf5c8eb522f047cd8da62bf0b14e9e38 for inclusion in 27a4c8afde515956994670de0df3cf30/family1 2023-03-07 10:54:45,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-07 10:54:45,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(777): Region bounds: first= last= 2023-03-07 10:54:45,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for 27a4c8afde515956994670de0df3cf30: 2023-03-07 10:54:45,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bf5c8eb522f047cd8da62bf0b14e9e38 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ub14cqe58fiu8569i3drlvsvpetrfp63dgcim2jfknekbltgc441u3vdb46gc6te/family1/bf5c8eb522f047cd8da62bf0b14e9e38 2023-03-07 10:54:45,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ub14cqe58fiu8569i3drlvsvpetrfp63dgcim2jfknekbltgc441u3vdb46gc6te/family1/bf5c8eb522f047cd8da62bf0b14e9e38 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/5683ad3336ca4a1cbeac6eb77df559e2_SeqId_44_ 2023-03-07 10:54:45,651 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ub14cqe58fiu8569i3drlvsvpetrfp63dgcim2jfknekbltgc441u3vdb46gc6te/family1/bf5c8eb522f047cd8da62bf0b14e9e38 into 27a4c8afde515956994670de0df3cf30/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/5683ad3336ca4a1cbeac6eb77df559e2_SeqId_44_ - updating store file list. 2023-03-07 10:54:45,654 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/5683ad3336ca4a1cbeac6eb77df559e2_SeqId_44_ into 27a4c8afde515956994670de0df3cf30/family1 2023-03-07 10:54:45,654 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ub14cqe58fiu8569i3drlvsvpetrfp63dgcim2jfknekbltgc441u3vdb46gc6te/family1/bf5c8eb522f047cd8da62bf0b14e9e38 into 27a4c8afde515956994670de0df3cf30/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/5683ad3336ca4a1cbeac6eb77df559e2_SeqId_44_) 2023-03-07 10:54:45,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ub14cqe58fiu8569i3drlvsvpetrfp63dgcim2jfknekbltgc441u3vdb46gc6te/family1/bf5c8eb522f047cd8da62bf0b14e9e38 2023-03-07 10:54:45,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-07 10:54:45,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-07 10:54:45,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(1912): 27a4c8afde515956994670de0df3cf30/family1 is initiating minor compaction 2023-03-07 10:54:45,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5f3c8b4c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:54:45,657 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 27a4c8afde515956994670de0df3cf30/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:45,658 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/4b21cfcbe0e74324b7ca9cf06ef655be, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/0a6e6a49b65d43569719bebf41f4d1cd, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/70482b6431bd45f9a992f99d48d71ec4, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/b647d5e6041f4fd4b2953bb916efbb22, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/506fbd7f875c45fb996473bc40e2f3cf, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/173a7de702ce46bf81ac670e1b689f49, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/245aa7604c44442c8c25da46d4ff6c98, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/81ac25f09fdb4022929342dbc85bbb80, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/25b6e20b72d2499b929dca92fa640975, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/5683ad3336ca4a1cbeac6eb77df559e2_SeqId_44_] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/.tmp, totalSize=50.4 K 2023-03-07 10:54:45,658 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 4b21cfcbe0e74324b7ca9cf06ef655be, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-07 10:54:45,658 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 0a6e6a49b65d43569719bebf41f4d1cd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-07 10:54:45,658 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 70482b6431bd45f9a992f99d48d71ec4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-07 10:54:45,658 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting b647d5e6041f4fd4b2953bb916efbb22, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-07 10:54:45,658 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 506fbd7f875c45fb996473bc40e2f3cf, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-07 10:54:45,658 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 173a7de702ce46bf81ac670e1b689f49, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-07 10:54:45,658 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 245aa7604c44442c8c25da46d4ff6c98, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-07 10:54:45,658 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 81ac25f09fdb4022929342dbc85bbb80, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-07 10:54:45,658 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 25b6e20b72d2499b929dca92fa640975, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-07 10:54:45,658 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 5683ad3336ca4a1cbeac6eb77df559e2_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-07 10:54:45,659 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-07 10:54:45,660 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:54:45,662 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122812d14da0754b44a6bac2f6b47b07cd76 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122812d14da0754b44a6bac2f6b47b07cd76 2023-03-07 10:54:45,663 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123192df3fe9fc494901a3fabf15c9308c53 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123192df3fe9fc494901a3fabf15c9308c53 2023-03-07 10:54:45,665 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101e3fc1c213e3b42bfab1472a2be5fd77b to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101e3fc1c213e3b42bfab1472a2be5fd77b 2023-03-07 10:54:45,666 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103d9314bb1efe64f4eb144f8d07f7c446a to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103d9314bb1efe64f4eb144f8d07f7c446a 2023-03-07 10:54:45,666 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-03-07 10:54:45,666 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-07 10:54:45,666 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-07 10:54:45,666 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-07 10:54:45,666 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-07 10:54:45,667 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-07 10:54:45,667 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-07 10:54:45,667 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-07 10:54:45,667 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-07 10:54:45,667 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-07 10:54:45,686 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] throttle.PressureAwareThroughputController(145): 27a4c8afde515956994670de0df3cf30#family1#compaction#61 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:54:46,504 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/.tmp/family1/1152931ee6d2414681463318de0ed944 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/1152931ee6d2414681463318de0ed944 2023-03-07 10:54:46,509 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 27a4c8afde515956994670de0df3cf30/family1 of 27a4c8afde515956994670de0df3cf30 into 1152931ee6d2414681463318de0ed944(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-07 10:54:46,509 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 27a4c8afde515956994670de0df3cf30: 2023-03-07 10:54:46,509 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1678186485657; duration=0sec 2023-03-07 10:54:46,509 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:54:46,518 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120581860155da2e40e98292907ace054702 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120581860155da2e40e98292907ace054702 2023-03-07 10:54:46,519 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-07 10:54:46,542 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f909918de12f467b80d24e29f89dbac8 first=Optional[r00] last=Optional[r2] 2023-03-07 10:54:46,543 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f909918de12f467b80d24e29f89dbac8}] 2023-03-07 10:54:46,545 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f909918de12f467b80d24e29f89dbac8 for inclusion in 27a4c8afde515956994670de0df3cf30/family1 2023-03-07 10:54:46,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-07 10:54:46,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(777): Region bounds: first= last= 2023-03-07 10:54:46,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for 27a4c8afde515956994670de0df3cf30: 2023-03-07 10:54:46,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f909918de12f467b80d24e29f89dbac8 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ps79g1uhgd58gi8gv7as41uafjjm9d2qvk8cborclr4jr1c71s1u6akud3ougugm/family1/f909918de12f467b80d24e29f89dbac8 2023-03-07 10:54:46,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ps79g1uhgd58gi8gv7as41uafjjm9d2qvk8cborclr4jr1c71s1u6akud3ougugm/family1/f909918de12f467b80d24e29f89dbac8 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/e22adac67f0e484c99aa4eedc07cf6c7_SeqId_47_ 2023-03-07 10:54:46,551 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ps79g1uhgd58gi8gv7as41uafjjm9d2qvk8cborclr4jr1c71s1u6akud3ougugm/family1/f909918de12f467b80d24e29f89dbac8 into 27a4c8afde515956994670de0df3cf30/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/e22adac67f0e484c99aa4eedc07cf6c7_SeqId_47_ - updating store file list. 2023-03-07 10:54:46,554 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/e22adac67f0e484c99aa4eedc07cf6c7_SeqId_47_ into 27a4c8afde515956994670de0df3cf30/family1 2023-03-07 10:54:46,555 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ps79g1uhgd58gi8gv7as41uafjjm9d2qvk8cborclr4jr1c71s1u6akud3ougugm/family1/f909918de12f467b80d24e29f89dbac8 into 27a4c8afde515956994670de0df3cf30/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/e22adac67f0e484c99aa4eedc07cf6c7_SeqId_47_) 2023-03-07 10:54:46,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ps79g1uhgd58gi8gv7as41uafjjm9d2qvk8cborclr4jr1c71s1u6akud3ougugm/family1/f909918de12f467b80d24e29f89dbac8 2023-03-07 10:54:46,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-07 10:54:46,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-07 10:54:46,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(1912): 27a4c8afde515956994670de0df3cf30/family1 is initiating minor compaction (all files) 2023-03-07 10:54:46,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3dde2d65; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:54:46,557 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 27a4c8afde515956994670de0df3cf30/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:46,557 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/8060b1ef2c8044a29edcb5867036859d, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/1152931ee6d2414681463318de0ed944, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/e22adac67f0e484c99aa4eedc07cf6c7_SeqId_47_] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/.tmp, totalSize=390.1 K 2023-03-07 10:54:46,557 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 8060b1ef2c8044a29edcb5867036859d, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878838856 2023-03-07 10:54:46,558 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 1152931ee6d2414681463318de0ed944, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621238856 2023-03-07 10:54:46,559 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting e22adac67f0e484c99aa4eedc07cf6c7_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878838856 2023-03-07 10:54:46,559 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-07 10:54:46,559 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:54:46,561 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113032ce4261516f46cc81ec4c16b62e0d47 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113032ce4261516f46cc81ec4c16b62e0d47 2023-03-07 10:54:46,562 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120168d1bb78f09c43bcacb8f41e977de03e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120168d1bb78f09c43bcacb8f41e977de03e 2023-03-07 10:54:46,564 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120503369e35222d44cfbbb799c65e3cea2b to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120503369e35222d44cfbbb799c65e3cea2b 2023-03-07 10:54:46,564 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-03-07 10:54:46,564 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-07 10:54:46,564 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-07 10:54:46,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-07 10:54:46,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:54:46,566 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-07 10:54:46,568 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.8210 sec 2023-03-07 10:54:46,579 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/4b21cfcbe0e74324b7ca9cf06ef655be, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/0a6e6a49b65d43569719bebf41f4d1cd, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/70482b6431bd45f9a992f99d48d71ec4, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/b647d5e6041f4fd4b2953bb916efbb22, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/506fbd7f875c45fb996473bc40e2f3cf, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/173a7de702ce46bf81ac670e1b689f49, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/245aa7604c44442c8c25da46d4ff6c98, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/81ac25f09fdb4022929342dbc85bbb80, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/25b6e20b72d2499b929dca92fa640975, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/5683ad3336ca4a1cbeac6eb77df559e2_SeqId_44_] to archive 2023-03-07 10:54:46,580 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:54:46,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/4b21cfcbe0e74324b7ca9cf06ef655be to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/4b21cfcbe0e74324b7ca9cf06ef655be 2023-03-07 10:54:46,583 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/0a6e6a49b65d43569719bebf41f4d1cd to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/0a6e6a49b65d43569719bebf41f4d1cd 2023-03-07 10:54:46,584 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/70482b6431bd45f9a992f99d48d71ec4 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/70482b6431bd45f9a992f99d48d71ec4 2023-03-07 10:54:46,586 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/b647d5e6041f4fd4b2953bb916efbb22 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/b647d5e6041f4fd4b2953bb916efbb22 2023-03-07 10:54:46,587 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/506fbd7f875c45fb996473bc40e2f3cf to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/506fbd7f875c45fb996473bc40e2f3cf 2023-03-07 10:54:46,587 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] throttle.PressureAwareThroughputController(145): 27a4c8afde515956994670de0df3cf30#family1#compaction#62 average throughput is 11.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:54:46,588 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/173a7de702ce46bf81ac670e1b689f49 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/173a7de702ce46bf81ac670e1b689f49 2023-03-07 10:54:46,589 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/245aa7604c44442c8c25da46d4ff6c98 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/245aa7604c44442c8c25da46d4ff6c98 2023-03-07 10:54:46,591 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/81ac25f09fdb4022929342dbc85bbb80 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/81ac25f09fdb4022929342dbc85bbb80 2023-03-07 10:54:46,592 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/25b6e20b72d2499b929dca92fa640975 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/25b6e20b72d2499b929dca92fa640975 2023-03-07 10:54:46,593 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/5683ad3336ca4a1cbeac6eb77df559e2_SeqId_44_ to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/5683ad3336ca4a1cbeac6eb77df559e2_SeqId_44_ 2023-03-07 10:54:46,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-07 10:54:46,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:47,065 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-07 10:54:47,066 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-03-07 10:54:47,066 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-07 10:54:47,068 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-03-07 10:54:47,071 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=27a4c8afde515956994670de0df3cf30, REOPEN/MOVE}] 2023-03-07 10:54:47,072 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=27a4c8afde515956994670de0df3cf30, REOPEN/MOVE 2023-03-07 10:54:47,072 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=27a4c8afde515956994670de0df3cf30, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:47,072 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678186487072"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186487072"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186487072"}]},"ts":"1678186487072"} 2023-03-07 10:54:47,074 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 27a4c8afde515956994670de0df3cf30, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:54:47,226 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 27a4c8afde515956994670de0df3cf30 2023-03-07 10:54:47,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 27a4c8afde515956994670de0df3cf30, disabling compactions & flushes 2023-03-07 10:54:47,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:47,806 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/.tmp/family1/c4426d573f6c42748dfa52294d2ead10 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/c4426d573f6c42748dfa52294d2ead10 2023-03-07 10:54:47,812 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 27a4c8afde515956994670de0df3cf30/family1 of 27a4c8afde515956994670de0df3cf30 into c4426d573f6c42748dfa52294d2ead10(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-07 10:54:47,812 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 27a4c8afde515956994670de0df3cf30: 2023-03-07 10:54:47,812 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:47,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:47,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. after waiting 0 ms 2023-03-07 10:54:47,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:47,812 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1678186486556; duration=1sec 2023-03-07 10:54:47,812 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:54:47,812 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/8060b1ef2c8044a29edcb5867036859d, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/1152931ee6d2414681463318de0ed944, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/e22adac67f0e484c99aa4eedc07cf6c7_SeqId_47_] to archive 2023-03-07 10:54:47,813 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:54:47,815 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/8060b1ef2c8044a29edcb5867036859d to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/8060b1ef2c8044a29edcb5867036859d 2023-03-07 10:54:47,816 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/1152931ee6d2414681463318de0ed944 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/1152931ee6d2414681463318de0ed944 2023-03-07 10:54:47,817 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/e22adac67f0e484c99aa4eedc07cf6c7_SeqId_47_ to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/e22adac67f0e484c99aa4eedc07cf6c7_SeqId_47_ 2023-03-07 10:54:47,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-07 10:54:47,823 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:47,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 27a4c8afde515956994670de0df3cf30: 2023-03-07 10:54:47,823 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 27a4c8afde515956994670de0df3cf30 to self. 2023-03-07 10:54:47,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 27a4c8afde515956994670de0df3cf30 2023-03-07 10:54:47,824 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=27a4c8afde515956994670de0df3cf30, regionState=CLOSED 2023-03-07 10:54:47,825 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678186487824"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186487824"}]},"ts":"1678186487824"} 2023-03-07 10:54:47,827 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-03-07 10:54:47,827 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 27a4c8afde515956994670de0df3cf30, server=jenkins-hbase4.apache.org,39673,1678186416064 in 752 msec 2023-03-07 10:54:47,827 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=27a4c8afde515956994670de0df3cf30, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,39673,1678186416064; forceNewPlan=false, retain=true 2023-03-07 10:54:47,978 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=27a4c8afde515956994670de0df3cf30, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:47,978 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678186487978"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186487978"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186487978"}]},"ts":"1678186487978"} 2023-03-07 10:54:47,980 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 27a4c8afde515956994670de0df3cf30, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:54:48,134 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:48,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 27a4c8afde515956994670de0df3cf30, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30.', STARTKEY => '', ENDKEY => ''} 2023-03-07 10:54:48,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 27a4c8afde515956994670de0df3cf30 2023-03-07 10:54:48,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:54:48,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 27a4c8afde515956994670de0df3cf30 2023-03-07 10:54:48,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 27a4c8afde515956994670de0df3cf30 2023-03-07 10:54:48,137 INFO [StoreOpener-27a4c8afde515956994670de0df3cf30-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 27a4c8afde515956994670de0df3cf30 2023-03-07 10:54:48,138 DEBUG [StoreOpener-27a4c8afde515956994670de0df3cf30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1 2023-03-07 10:54:48,138 DEBUG [StoreOpener-27a4c8afde515956994670de0df3cf30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1 2023-03-07 10:54:48,138 INFO [StoreOpener-27a4c8afde515956994670de0df3cf30-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 27a4c8afde515956994670de0df3cf30 columnFamilyName family1 2023-03-07 10:54:48,143 DEBUG [StoreOpener-27a4c8afde515956994670de0df3cf30-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/c4426d573f6c42748dfa52294d2ead10 2023-03-07 10:54:48,143 INFO [StoreOpener-27a4c8afde515956994670de0df3cf30-1] regionserver.HStore(310): Store=27a4c8afde515956994670de0df3cf30/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:54:48,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30 2023-03-07 10:54:48,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30 2023-03-07 10:54:48,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 27a4c8afde515956994670de0df3cf30 2023-03-07 10:54:48,150 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 27a4c8afde515956994670de0df3cf30; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59446179, jitterRate=-0.11418290436267853}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-07 10:54:48,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 27a4c8afde515956994670de0df3cf30: 2023-03-07 10:54:48,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30., pid=47, masterSystemTime=1678186488131 2023-03-07 10:54:48,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:48,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:48,153 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=27a4c8afde515956994670de0df3cf30, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:48,154 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678186488153"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186488153"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186488153"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186488153"}]},"ts":"1678186488153"} 2023-03-07 10:54:48,156 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-03-07 10:54:48,156 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 27a4c8afde515956994670de0df3cf30, server=jenkins-hbase4.apache.org,39673,1678186416064 in 175 msec 2023-03-07 10:54:48,158 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-03-07 10:54:48,158 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=27a4c8afde515956994670de0df3cf30, REOPEN/MOVE in 1.0850 sec 2023-03-07 10:54:48,160 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-03-07 10:54:48,160 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0900 sec 2023-03-07 10:54:48,162 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.5050 sec 2023-03-07 10:54:48,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-03-07 10:54:48,163 INFO [Listener at localhost/42383] compactions.TestMobCompactor(278): alter status finished 2023-03-07 10:54:48,164 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45579] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:48,165 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-07 10:54:48,166 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-07 10:54:48,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:54:48,167 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678187088167 2023-03-07 10:54:48,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-07 10:54:48,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-07 10:54:48,170 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-07 10:54:48,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] zookeeper.ReadOnlyZKClient(139): Connect 0x45ea41a0 to 127.0.0.1:56055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-07 10:54:48,174 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b3b1072, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-07 10:54:48,175 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-07 10:54:48,175 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-07 10:54:48,175 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-07 10:54:48,175 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-07 10:54:48,175 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-07 10:54:48,602 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511289d56f7682a3c47c4ae62ec3a0f5ce92f to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511289d56f7682a3c47c4ae62ec3a0f5ce92f 2023-03-07 10:54:48,604 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-07 10:54:48,616 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-07 10:54:48,618 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58882, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-07 10:54:48,624 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-07 10:54:48,626 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46586, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-07 10:54:48,635 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/aac855146ca54ff0801c5c62a17e79a3 first=Optional[r05] last=Optional[r8] 2023-03-07 10:54:48,635 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=51 for row with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/aac855146ca54ff0801c5c62a17e79a3}] 2023-03-07 10:54:48,640 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/aac855146ca54ff0801c5c62a17e79a3 for inclusion in 27a4c8afde515956994670de0df3cf30/family1 2023-03-07 10:54:48,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-07 10:54:48,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(777): Region bounds: first= last= 2023-03-07 10:54:48,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for 27a4c8afde515956994670de0df3cf30: 2023-03-07 10:54:48,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/aac855146ca54ff0801c5c62a17e79a3 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__bgb7fnln0m67alt1e57n896dnuk6e8df61qs9o4be717h9ojk2u4u03acadcv2h0/family1/aac855146ca54ff0801c5c62a17e79a3 2023-03-07 10:54:48,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__bgb7fnln0m67alt1e57n896dnuk6e8df61qs9o4be717h9ojk2u4u03acadcv2h0/family1/aac855146ca54ff0801c5c62a17e79a3 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/93cbbc7178a14a409e1a834a8e89a3a1_SeqId_53_ 2023-03-07 10:54:48,648 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__bgb7fnln0m67alt1e57n896dnuk6e8df61qs9o4be717h9ojk2u4u03acadcv2h0/family1/aac855146ca54ff0801c5c62a17e79a3 into 27a4c8afde515956994670de0df3cf30/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/93cbbc7178a14a409e1a834a8e89a3a1_SeqId_53_ - updating store file list. 2023-03-07 10:54:48,652 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/93cbbc7178a14a409e1a834a8e89a3a1_SeqId_53_ into 27a4c8afde515956994670de0df3cf30/family1 2023-03-07 10:54:48,652 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__bgb7fnln0m67alt1e57n896dnuk6e8df61qs9o4be717h9ojk2u4u03acadcv2h0/family1/aac855146ca54ff0801c5c62a17e79a3 into 27a4c8afde515956994670de0df3cf30/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/93cbbc7178a14a409e1a834a8e89a3a1_SeqId_53_) 2023-03-07 10:54:48,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__bgb7fnln0m67alt1e57n896dnuk6e8df61qs9o4be717h9ojk2u4u03acadcv2h0/family1/aac855146ca54ff0801c5c62a17e79a3 2023-03-07 10:54:48,654 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-07 10:54:48,655 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:54:48,657 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511205a14d6692a0742a4852ba2b7fc26bfef to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511205a14d6692a0742a4852ba2b7fc26bfef 2023-03-07 10:54:48,658 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511287fc0847e3fd7426e87a0bd9388836455 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511287fc0847e3fd7426e87a0bd9388836455 2023-03-07 10:54:48,658 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-03-07 10:54:48,658 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-07 10:54:48,658 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-07 10:54:48,658 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-07 10:54:48,659 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-07 10:54:48,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-07 10:54:48,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:54:48,660 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-07 10:54:48,661 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 495 msec 2023-03-07 10:54:48,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-07 10:54:48,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:49,128 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-03-07 10:54:49,129 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-07 10:54:49,129 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-03-07 10:54:49,131 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-03-07 10:54:49,135 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=27a4c8afde515956994670de0df3cf30, REOPEN/MOVE}] 2023-03-07 10:54:49,136 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=27a4c8afde515956994670de0df3cf30, REOPEN/MOVE 2023-03-07 10:54:49,137 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=27a4c8afde515956994670de0df3cf30, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:49,137 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678186489137"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186489137"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186489137"}]},"ts":"1678186489137"} 2023-03-07 10:54:49,138 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 27a4c8afde515956994670de0df3cf30, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:54:49,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 27a4c8afde515956994670de0df3cf30 2023-03-07 10:54:49,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 27a4c8afde515956994670de0df3cf30, disabling compactions & flushes 2023-03-07 10:54:49,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:49,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:49,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. after waiting 0 ms 2023-03-07 10:54:49,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:49,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-07 10:54:49,297 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:49,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 27a4c8afde515956994670de0df3cf30: 2023-03-07 10:54:49,297 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 27a4c8afde515956994670de0df3cf30 to self. 2023-03-07 10:54:49,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 27a4c8afde515956994670de0df3cf30 2023-03-07 10:54:49,299 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=27a4c8afde515956994670de0df3cf30, regionState=CLOSED 2023-03-07 10:54:49,299 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678186489299"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186489299"}]},"ts":"1678186489299"} 2023-03-07 10:54:49,301 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-03-07 10:54:49,301 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 27a4c8afde515956994670de0df3cf30, server=jenkins-hbase4.apache.org,39673,1678186416064 in 162 msec 2023-03-07 10:54:49,302 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=27a4c8afde515956994670de0df3cf30, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,39673,1678186416064; forceNewPlan=false, retain=true 2023-03-07 10:54:49,452 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=27a4c8afde515956994670de0df3cf30, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:49,452 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678186489452"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186489452"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186489452"}]},"ts":"1678186489452"} 2023-03-07 10:54:49,480 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 27a4c8afde515956994670de0df3cf30, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:54:49,481 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-07 10:54:49,481 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x283f34e5 to 127.0.0.1:56055 2023-03-07 10:54:49,481 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-07 10:54:49,481 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-07 10:54:49,481 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7601903e to 127.0.0.1:56055 2023-03-07 10:54:49,481 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-07 10:54:49,481 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-07 10:54:49,482 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45ea41a0 to 127.0.0.1:56055 2023-03-07 10:54:49,482 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-07 10:54:49,482 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-07 10:54:49,482 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71761a10 to 127.0.0.1:56055 2023-03-07 10:54:49,482 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-07 10:54:49,482 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-07 10:54:49,483 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1869b4df to 127.0.0.1:56055 2023-03-07 10:54:49,483 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-07 10:54:49,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:49,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 27a4c8afde515956994670de0df3cf30, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30.', STARTKEY => '', ENDKEY => ''} 2023-03-07 10:54:49,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 27a4c8afde515956994670de0df3cf30 2023-03-07 10:54:49,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:54:49,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 27a4c8afde515956994670de0df3cf30 2023-03-07 10:54:49,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 27a4c8afde515956994670de0df3cf30 2023-03-07 10:54:49,638 INFO [StoreOpener-27a4c8afde515956994670de0df3cf30-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 27a4c8afde515956994670de0df3cf30 2023-03-07 10:54:49,638 DEBUG [StoreOpener-27a4c8afde515956994670de0df3cf30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1 2023-03-07 10:54:49,639 DEBUG [StoreOpener-27a4c8afde515956994670de0df3cf30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1 2023-03-07 10:54:49,639 INFO [StoreOpener-27a4c8afde515956994670de0df3cf30-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 27a4c8afde515956994670de0df3cf30 columnFamilyName family1 2023-03-07 10:54:49,644 DEBUG [StoreOpener-27a4c8afde515956994670de0df3cf30-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/93cbbc7178a14a409e1a834a8e89a3a1_SeqId_53_ 2023-03-07 10:54:49,647 DEBUG [StoreOpener-27a4c8afde515956994670de0df3cf30-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/family1/c4426d573f6c42748dfa52294d2ead10 2023-03-07 10:54:49,647 INFO [StoreOpener-27a4c8afde515956994670de0df3cf30-1] regionserver.HStore(310): Store=27a4c8afde515956994670de0df3cf30/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:54:49,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30 2023-03-07 10:54:49,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30 2023-03-07 10:54:49,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 27a4c8afde515956994670de0df3cf30 2023-03-07 10:54:49,652 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 27a4c8afde515956994670de0df3cf30; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59544213, jitterRate=-0.11272208392620087}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-07 10:54:49,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 27a4c8afde515956994670de0df3cf30: 2023-03-07 10:54:49,652 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30., pid=53, masterSystemTime=1678186489633 2023-03-07 10:54:49,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:49,654 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:54:49,654 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=27a4c8afde515956994670de0df3cf30, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:49,654 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678186489654"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186489654"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186489654"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186489654"}]},"ts":"1678186489654"} 2023-03-07 10:54:49,657 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-03-07 10:54:49,657 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 27a4c8afde515956994670de0df3cf30, server=jenkins-hbase4.apache.org,39673,1678186416064 in 175 msec 2023-03-07 10:54:49,658 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-03-07 10:54:49,658 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=27a4c8afde515956994670de0df3cf30, REOPEN/MOVE in 522 msec 2023-03-07 10:54:49,659 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-03-07 10:54:49,659 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 527 msec 2023-03-07 10:54:49,661 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 946 msec 2023-03-07 10:54:49,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-03-07 10:54:49,663 INFO [Listener at localhost/42383] compactions.TestMobCompactor(278): alter status finished 2023-03-07 10:54:49,664 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45579] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-07 10:54:49,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-07 10:54:49,666 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-07 10:54:49,667 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:54:49,667 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678187089667 2023-03-07 10:54:49,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-07 10:54:49,669 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-07 10:54:49,669 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-07 10:54:49,669 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] zookeeper.ReadOnlyZKClient(139): Connect 0x4e3ca89e to 127.0.0.1:56055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-07 10:54:49,675 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d1799ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-07 10:54:49,675 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-07 10:54:49,675 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-07 10:54:49,675 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-07 10:54:49,675 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-07 10:54:49,675 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-07 10:54:49,675 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-07 10:54:49,675 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-07 10:54:49,675 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-07 10:54:49,675 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-07 10:54:49,675 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:54:49,676 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-07 10:54:49,677 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 11 msec 2023-03-07 10:54:49,723 INFO [Listener at localhost/42383] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=243 (was 263), OpenFileDescriptor=606 (was 627), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=210 (was 235), ProcessCount=171 (was 171), AvailableMemoryMB=9498 (was 9547) 2023-03-07 10:54:49,734 INFO [Listener at localhost/42383] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=243, OpenFileDescriptor=606, MaxFileDescriptor=60000, SystemLoadAverage=210, ProcessCount=171, AvailableMemoryMB=9498 2023-03-07 10:54:49,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-07 10:54:49,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:49,739 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-03-07 10:54:49,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-03-07 10:54:49,740 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-07 10:54:49,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-07 10:54:49,741 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:54:49,741 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43 empty. 2023-03-07 10:54:49,742 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:54:49,742 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-03-07 10:54:49,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-07 10:54:50,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-07 10:54:50,150 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-03-07 10:54:50,151 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => b1d149d88d390744a8d9cafdd3682b43, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp 2023-03-07 10:54:50,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-07 10:54:50,557 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:54:50,557 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing b1d149d88d390744a8d9cafdd3682b43, disabling compactions & flushes 2023-03-07 10:54:50,557 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:50,557 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:50,558 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. after waiting 0 ms 2023-03-07 10:54:50,558 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:50,558 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:50,558 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for b1d149d88d390744a8d9cafdd3682b43: 2023-03-07 10:54:50,560 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-03-07 10:54:50,561 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678186490560"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186490560"}]},"ts":"1678186490560"} 2023-03-07 10:54:50,562 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-07 10:54:50,562 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-07 10:54:50,562 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186490562"}]},"ts":"1678186490562"} 2023-03-07 10:54:50,563 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-03-07 10:54:50,566 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=b1d149d88d390744a8d9cafdd3682b43, ASSIGN}] 2023-03-07 10:54:50,567 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=b1d149d88d390744a8d9cafdd3682b43, ASSIGN 2023-03-07 10:54:50,568 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=b1d149d88d390744a8d9cafdd3682b43, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39673,1678186416064; forceNewPlan=false, retain=false 2023-03-07 10:54:50,719 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=b1d149d88d390744a8d9cafdd3682b43, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:50,719 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678186490719"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186490719"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186490719"}]},"ts":"1678186490719"} 2023-03-07 10:54:50,721 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure b1d149d88d390744a8d9cafdd3682b43, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:54:50,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-07 10:54:50,875 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:50,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b1d149d88d390744a8d9cafdd3682b43, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43.', STARTKEY => '', ENDKEY => ''} 2023-03-07 10:54:50,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:54:50,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:54:50,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:54:50,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:54:50,877 INFO [StoreOpener-b1d149d88d390744a8d9cafdd3682b43-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:54:50,879 DEBUG [StoreOpener-b1d149d88d390744a8d9cafdd3682b43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1 2023-03-07 10:54:50,879 DEBUG [StoreOpener-b1d149d88d390744a8d9cafdd3682b43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1 2023-03-07 10:54:50,879 INFO [StoreOpener-b1d149d88d390744a8d9cafdd3682b43-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b1d149d88d390744a8d9cafdd3682b43 columnFamilyName family1 2023-03-07 10:54:50,880 INFO [StoreOpener-b1d149d88d390744a8d9cafdd3682b43-1] regionserver.HStore(310): Store=b1d149d88d390744a8d9cafdd3682b43/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:54:50,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:54:50,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:54:50,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:54:50,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-07 10:54:50,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b1d149d88d390744a8d9cafdd3682b43; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63810277, jitterRate=-0.04915277659893036}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-07 10:54:50,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b1d149d88d390744a8d9cafdd3682b43: 2023-03-07 10:54:50,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43., pid=57, masterSystemTime=1678186490872 2023-03-07 10:54:50,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:50,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:50,889 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=b1d149d88d390744a8d9cafdd3682b43, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:50,889 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678186490889"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186490889"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186490889"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186490889"}]},"ts":"1678186490889"} 2023-03-07 10:54:50,891 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-03-07 10:54:50,891 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure b1d149d88d390744a8d9cafdd3682b43, server=jenkins-hbase4.apache.org,39673,1678186416064 in 169 msec 2023-03-07 10:54:50,892 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-03-07 10:54:50,892 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=b1d149d88d390744a8d9cafdd3682b43, ASSIGN in 325 msec 2023-03-07 10:54:50,893 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-07 10:54:50,893 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186490893"}]},"ts":"1678186490893"} 2023-03-07 10:54:50,894 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-03-07 10:54:50,896 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-03-07 10:54:50,897 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1590 sec 2023-03-07 10:54:51,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-07 10:54:51,845 INFO [Listener at localhost/42383] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-03-07 10:54:51,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:51,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:51,863 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-07 10:54:51,864 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:51,864 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-07 10:54:51,864 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-07 10:54:51,864 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:51,864 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:51,866 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:51,866 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:51,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:51,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:51,867 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:51,867 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:51,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:51,867 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:51,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:51,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:51,868 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:51,868 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:51,868 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-07 10:54:51,868 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:51,868 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-07 10:54:51,868 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:51,868 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:51,868 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:51,868 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. started... 2023-03-07 10:54:51,869 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b1d149d88d390744a8d9cafdd3682b43 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-07 10:54:52,290 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130d2768749ed6c43248a7c15b3e74040ad to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130d2768749ed6c43248a7c15b3e74040ad 2023-03-07 10:54:52,694 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/.tmp/family1/f284ba9ac1f843dfb3ec293af6d647c1 2023-03-07 10:54:52,699 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/.tmp/family1/f284ba9ac1f843dfb3ec293af6d647c1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/f284ba9ac1f843dfb3ec293af6d647c1 2023-03-07 10:54:52,703 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/f284ba9ac1f843dfb3ec293af6d647c1, entries=1000, sequenceid=5, filesize=190.5 K 2023-03-07 10:54:52,704 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for b1d149d88d390744a8d9cafdd3682b43 in 835ms, sequenceid=5, compaction requested=false 2023-03-07 10:54:52,704 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-07 10:54:52,704 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b1d149d88d390744a8d9cafdd3682b43: 2023-03-07 10:54:52,704 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:52,704 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:52,705 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:52,705 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:52,705 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-07 10:54:52,705 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-07 10:54:52,706 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,706 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:52,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:52,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:52,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:52,706 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,706 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:52,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:52,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:52,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:52,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:52,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-07 10:54:52,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@232c3b67[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:52,708 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-07 10:54:52,708 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,709 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,709 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-07 10:54:52,709 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:52,709 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:52,709 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-07 10:54:52,709 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:52,711 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:52,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:52,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:52,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:52,711 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-07 10:54:52,711 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:52,711 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-07 10:54:52,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:52,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:52,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:52,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:52,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:52,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:52,713 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-07 10:54:52,713 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-07 10:54:52,713 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:52,713 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:52,713 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,713 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:52,716 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,716 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:52,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:52,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,716 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:52,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:52,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:52,717 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:52,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:52,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:52,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,718 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:52,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:52,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:52,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:52,723 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:52,723 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,723 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,723 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:52,723 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:52,723 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:52,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-07 10:54:52,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:52,723 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,723 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:52,723 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:52,723 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:52,724 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:52,724 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:52,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-07 10:54:52,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:52,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:52,824 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:52,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:52,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:52,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:52,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,830 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-07 10:54:52,830 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:52,830 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-07 10:54:52,830 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-07 10:54:52,831 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,831 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,832 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:52,832 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:52,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:52,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:52,833 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:52,833 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:52,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,833 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:52,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,833 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,834 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-07 10:54:52,834 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:52,834 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-07 10:54:52,834 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:52,834 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-07 10:54:52,834 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:52,834 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:52,834 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:52,834 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. started... 2023-03-07 10:54:52,834 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b1d149d88d390744a8d9cafdd3682b43 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-07 10:54:53,251 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128d38684cbee1b4fb688e5cf40e3dc3da6 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128d38684cbee1b4fb688e5cf40e3dc3da6 2023-03-07 10:54:53,354 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-07 10:54:53,658 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/.tmp/family1/7979edb0ae0a4bb4942206ccb8bcdde5 2023-03-07 10:54:53,662 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/.tmp/family1/7979edb0ae0a4bb4942206ccb8bcdde5 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/7979edb0ae0a4bb4942206ccb8bcdde5 2023-03-07 10:54:53,666 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/7979edb0ae0a4bb4942206ccb8bcdde5, entries=1, sequenceid=9, filesize=5.0 K 2023-03-07 10:54:53,667 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for b1d149d88d390744a8d9cafdd3682b43 in 833ms, sequenceid=9, compaction requested=false 2023-03-07 10:54:53,667 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b1d149d88d390744a8d9cafdd3682b43: 2023-03-07 10:54:53,667 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:53,667 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:53,667 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:53,667 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:53,667 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-07 10:54:53,667 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-07 10:54:53,669 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:53,669 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:53,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:53,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:53,669 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,669 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:53,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:53,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:53,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:53,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:53,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-07 10:54:53,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b3b7ef4[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:53,670 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-07 10:54:53,670 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,672 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,672 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-07 10:54:53,672 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-07 10:54:53,672 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:53,672 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:53,672 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:53,674 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-07 10:54:53,674 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:53,674 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:53,674 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-07 10:54:53,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:53,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:53,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:53,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:53,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:53,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:53,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:53,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:53,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:53,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-07 10:54:53,676 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-07 10:54:53,676 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:53,676 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:53,676 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,676 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:53,677 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,677 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:53,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,678 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:53,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:53,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:53,678 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:53,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:53,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:53,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:53,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:53,679 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:53,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:53,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:53,681 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:53,681 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:53,681 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:53,681 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-07 10:54:53,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-07 10:54:53,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:53,681 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,681 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:53,681 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:53,682 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:53,682 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:53,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:53,682 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:53,682 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,682 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,682 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:53,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:53,782 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:53,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:53,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:53,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:53,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,788 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-07 10:54:53,788 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:53,788 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-07 10:54:53,788 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-07 10:54:53,788 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,788 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,790 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:53,790 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:53,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:53,790 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:53,790 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:53,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:53,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:53,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,791 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,791 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-07 10:54:53,792 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:53,792 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-07 10:54:53,792 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:53,792 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-07 10:54:53,792 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:53,792 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:53,792 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:53,792 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. started... 2023-03-07 10:54:53,792 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b1d149d88d390744a8d9cafdd3682b43 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:54,204 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201dafb1bc66c544ee5b5997e3d2cf3fcab to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201dafb1bc66c544ee5b5997e3d2cf3fcab 2023-03-07 10:54:54,609 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/.tmp/family1/2bed810caccc4a71a2997cb1d57fa5fa 2023-03-07 10:54:54,614 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/.tmp/family1/2bed810caccc4a71a2997cb1d57fa5fa as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/2bed810caccc4a71a2997cb1d57fa5fa 2023-03-07 10:54:54,618 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/2bed810caccc4a71a2997cb1d57fa5fa, entries=1, sequenceid=13, filesize=5.0 K 2023-03-07 10:54:54,619 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b1d149d88d390744a8d9cafdd3682b43 in 827ms, sequenceid=13, compaction requested=true 2023-03-07 10:54:54,619 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b1d149d88d390744a8d9cafdd3682b43: 2023-03-07 10:54:54,619 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:54,619 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:54,619 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:54,619 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:54,619 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-07 10:54:54,619 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-07 10:54:54,620 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:54,620 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:54,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:54,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:54,621 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,621 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:54,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:54,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:54,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:54,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:54,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-07 10:54:54,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3cc9c7de[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:54,622 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-07 10:54:54,622 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,623 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,623 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:54,623 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:54,623 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-07 10:54:54,624 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-07 10:54:54,624 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:54,625 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-07 10:54:54,625 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:54,625 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:54,625 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-07 10:54:54,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:54,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:54,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:54,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:54,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:54,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:54,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:54,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:54,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:54,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-07 10:54:54,627 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-07 10:54:54,627 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:54,627 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:54,627 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,627 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:54,629 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,629 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,630 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:54,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:54,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:54,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,630 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:54,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:54,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:54,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:54,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:54,631 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:54,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:54,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:54,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:54,633 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:54,633 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:54,633 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:54,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:54,633 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:54,633 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:54,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-07 10:54:54,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:54,633 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:54,633 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-07 10:54:54,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:54,633 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:54,634 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,634 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:54,634 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:54,634 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,634 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,734 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:54,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:54,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:54,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:54,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,740 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-07 10:54:54,740 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:54,740 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-07 10:54:54,740 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-07 10:54:54,740 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,740 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,742 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:54,742 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:54,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:54,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:54,742 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:54,742 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:54,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:54,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,743 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,743 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-07 10:54:54,743 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:54,743 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-07 10:54:54,743 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:54,743 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-07 10:54:54,744 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:54,744 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:54,744 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:54,744 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. started... 2023-03-07 10:54:54,744 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b1d149d88d390744a8d9cafdd3682b43 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:55,156 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120533979ad6718b4768a7823843e9363395 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120533979ad6718b4768a7823843e9363395 2023-03-07 10:54:55,163 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/.tmp/family1/d0fa86edb35e4bd28cce31c427a04375 2023-03-07 10:54:55,168 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/.tmp/family1/d0fa86edb35e4bd28cce31c427a04375 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/d0fa86edb35e4bd28cce31c427a04375 2023-03-07 10:54:55,172 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/d0fa86edb35e4bd28cce31c427a04375, entries=1, sequenceid=17, filesize=5.0 K 2023-03-07 10:54:55,172 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b1d149d88d390744a8d9cafdd3682b43 in 428ms, sequenceid=17, compaction requested=true 2023-03-07 10:54:55,173 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b1d149d88d390744a8d9cafdd3682b43: 2023-03-07 10:54:55,173 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:55,173 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:55,173 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:55,173 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:55,173 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-07 10:54:55,173 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-07 10:54:55,174 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,174 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:55,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:55,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:55,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:55,175 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,175 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:55,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:55,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:55,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:55,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:55,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-07 10:54:55,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28fd180a[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:55,176 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-07 10:54:55,176 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,185 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,186 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-07 10:54:55,186 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-07 10:54:55,186 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:55,186 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:55,186 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:55,187 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-07 10:54:55,187 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:55,187 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:55,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:55,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:55,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:55,187 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-07 10:54:55,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:55,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:55,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:55,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:55,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:55,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:55,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-07 10:54:55,189 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-07 10:54:55,189 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:55,189 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:55,189 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,189 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:55,191 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,191 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:55,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:55,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,191 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:55,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:55,191 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:55,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:55,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:55,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:55,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,192 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:55,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:55,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:55,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:55,196 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:55,196 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,196 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-07 10:54:55,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:55,196 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:55,196 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:55,196 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:55,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:55,196 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:55,196 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:55,196 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,196 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:55,196 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-07 10:54:55,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:55,196 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,197 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:55,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:55,296 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:55,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:55,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:55,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:55,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,302 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-07 10:54:55,303 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:55,303 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-07 10:54:55,303 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-07 10:54:55,303 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,303 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,304 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:55,304 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:55,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:55,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:55,305 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:55,305 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:55,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,305 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:55,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,305 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,305 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-07 10:54:55,306 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:55,306 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-07 10:54:55,306 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:55,306 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-07 10:54:55,306 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:55,306 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:55,306 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:55,306 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. started... 2023-03-07 10:54:55,306 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b1d149d88d390744a8d9cafdd3682b43 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:55,373 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-07 10:54:55,719 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228185ec79ea9414606966af255d7f5ebe1 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228185ec79ea9414606966af255d7f5ebe1 2023-03-07 10:54:56,124 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/.tmp/family1/3334296a85384722af56ce8e8b2c3a48 2023-03-07 10:54:56,130 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/.tmp/family1/3334296a85384722af56ce8e8b2c3a48 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/3334296a85384722af56ce8e8b2c3a48 2023-03-07 10:54:56,134 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/3334296a85384722af56ce8e8b2c3a48, entries=1, sequenceid=21, filesize=5.0 K 2023-03-07 10:54:56,135 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b1d149d88d390744a8d9cafdd3682b43 in 829ms, sequenceid=21, compaction requested=true 2023-03-07 10:54:56,135 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b1d149d88d390744a8d9cafdd3682b43: 2023-03-07 10:54:56,135 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:56,135 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:56,135 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:56,135 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,135 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-07 10:54:56,135 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-07 10:54:56,137 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,137 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:56,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:56,138 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,138 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:56,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:56,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:56,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:56,139 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-07 10:54:56,139 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ac8e971[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:56,139 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-07 10:54:56,139 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,140 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,140 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-07 10:54:56,140 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-07 10:54:56,140 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:56,141 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,141 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:56,142 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-07 10:54:56,142 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:56,142 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,142 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-07 10:54:56,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:56,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:56,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:56,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:56,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:56,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:56,144 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-07 10:54:56,144 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-07 10:54:56,144 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:56,144 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:56,144 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,144 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:56,145 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,146 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,146 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:56,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:56,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:56,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:56,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:56,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:56,146 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:56,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,147 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:56,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,150 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,150 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,150 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,150 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,150 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:56,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-07 10:54:56,151 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:56,150 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:56,150 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:56,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:56,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:56,151 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,151 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,151 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:56,151 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:56,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:56,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:56,251 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:56,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:56,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:56,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:56,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,257 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-07 10:54:56,257 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:56,257 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-07 10:54:56,257 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-07 10:54:56,258 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,258 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,259 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:56,259 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:56,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:56,259 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,259 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:56,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,260 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:56,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,260 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,260 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-07 10:54:56,260 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,260 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-07 10:54:56,260 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:56,260 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-07 10:54:56,261 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:56,261 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:56,261 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:56,261 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. started... 2023-03-07 10:54:56,261 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b1d149d88d390744a8d9cafdd3682b43 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:56,677 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231f8d4a9c0c18a49c4be344a19f3c012c2 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231f8d4a9c0c18a49c4be344a19f3c012c2 2023-03-07 10:54:56,683 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/.tmp/family1/a432840aa36847afa0a83d4b7ad50cda 2023-03-07 10:54:56,687 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/.tmp/family1/a432840aa36847afa0a83d4b7ad50cda as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/a432840aa36847afa0a83d4b7ad50cda 2023-03-07 10:54:56,692 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/a432840aa36847afa0a83d4b7ad50cda, entries=1, sequenceid=25, filesize=5.0 K 2023-03-07 10:54:56,693 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b1d149d88d390744a8d9cafdd3682b43 in 431ms, sequenceid=25, compaction requested=true 2023-03-07 10:54:56,693 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b1d149d88d390744a8d9cafdd3682b43: 2023-03-07 10:54:56,693 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:56,693 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:56,693 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:56,693 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,693 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-07 10:54:56,693 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-07 10:54:56,694 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,694 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:56,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:56,695 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,695 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:56,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:56,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:56,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:56,696 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-07 10:54:56,696 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a44e602[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:56,696 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-07 10:54:56,696 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,697 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,698 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-07 10:54:56,698 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,698 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:56,698 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-07 10:54:56,698 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:56,700 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-07 10:54:56,700 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,700 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:56,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:56,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:56,700 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-07 10:54:56,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:56,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:56,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:56,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:56,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-07 10:54:56,703 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-07 10:54:56,703 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:56,703 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:56,703 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,703 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:56,705 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,705 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:56,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:56,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,705 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:56,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:56,705 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:56,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:56,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:56,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,707 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:56,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,712 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:56,712 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:56,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:56,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-07 10:54:56,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:56,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:56,712 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:56,712 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,712 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:56,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:56,712 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,712 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,712 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,712 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,712 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:56,712 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:56,713 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,813 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:56,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:56,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:56,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:56,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,818 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-07 10:54:56,819 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:56,819 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-07 10:54:56,819 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-07 10:54:56,819 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,819 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,822 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,822 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:56,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:56,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:56,823 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:56,823 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:56,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,823 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:56,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,824 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,824 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-07 10:54:56,824 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:56,824 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-07 10:54:56,824 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:56,824 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-07 10:54:56,824 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:56,824 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:56,824 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:56,824 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. started... 2023-03-07 10:54:56,824 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b1d149d88d390744a8d9cafdd3682b43 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:57,241 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601016ad2b1d4582c442fb1fb2cbf514d9524 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601016ad2b1d4582c442fb1fb2cbf514d9524 2023-03-07 10:54:57,647 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/.tmp/family1/ce8ff03557724a5890a05ea926f2612e 2023-03-07 10:54:57,651 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/.tmp/family1/ce8ff03557724a5890a05ea926f2612e as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/ce8ff03557724a5890a05ea926f2612e 2023-03-07 10:54:57,655 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/ce8ff03557724a5890a05ea926f2612e, entries=1, sequenceid=29, filesize=5.0 K 2023-03-07 10:54:57,656 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b1d149d88d390744a8d9cafdd3682b43 in 832ms, sequenceid=29, compaction requested=true 2023-03-07 10:54:57,656 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b1d149d88d390744a8d9cafdd3682b43: 2023-03-07 10:54:57,656 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:57,656 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:57,657 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:57,657 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,657 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-07 10:54:57,657 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-07 10:54:57,658 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,658 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:57,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:57,659 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,659 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:57,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:57,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:57,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:57,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-07 10:54:57,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@584133a3[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:57,660 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-07 10:54:57,660 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,661 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,661 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-07 10:54:57,661 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-07 10:54:57,661 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:57,661 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,661 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:57,664 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-07 10:54:57,664 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,664 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:57,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,664 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-07 10:54:57,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:57,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:57,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:57,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:57,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:57,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:57,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-07 10:54:57,666 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-07 10:54:57,666 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:57,666 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:57,666 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,666 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:57,668 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,668 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:57,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:57,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,668 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:57,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:57,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:57,668 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:57,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:57,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,669 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:57,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,671 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,671 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:57,671 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,671 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:57,671 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:57,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-07 10:54:57,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:57,671 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:57,672 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:57,672 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,672 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,672 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:57,672 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:57,672 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:57,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:57,772 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:57,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:57,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:57,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:57,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,780 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-07 10:54:57,780 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:57,780 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-07 10:54:57,780 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-07 10:54:57,780 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,781 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,782 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,782 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:57,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:57,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:57,782 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,782 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:57,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,783 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:57,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,783 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,783 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-07 10:54:57,783 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,783 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-07 10:54:57,783 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:57,783 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-07 10:54:57,784 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:57,784 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:57,784 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:57,784 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. started... 2023-03-07 10:54:57,784 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b1d149d88d390744a8d9cafdd3682b43 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:57,806 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038f0c24d4a2894b469baf620632febe71 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601038f0c24d4a2894b469baf620632febe71 2023-03-07 10:54:57,815 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/.tmp/family1/2b010cf0011f41ba90f03a7edeb8f4d3 2023-03-07 10:54:57,819 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/.tmp/family1/2b010cf0011f41ba90f03a7edeb8f4d3 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/2b010cf0011f41ba90f03a7edeb8f4d3 2023-03-07 10:54:57,824 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/2b010cf0011f41ba90f03a7edeb8f4d3, entries=1, sequenceid=33, filesize=5.0 K 2023-03-07 10:54:57,824 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b1d149d88d390744a8d9cafdd3682b43 in 40ms, sequenceid=33, compaction requested=true 2023-03-07 10:54:57,825 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b1d149d88d390744a8d9cafdd3682b43: 2023-03-07 10:54:57,825 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:57,825 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:57,825 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:57,825 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,825 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-07 10:54:57,825 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-07 10:54:57,827 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,827 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:57,828 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,828 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:57,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:57,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:57,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:57,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-07 10:54:57,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18bc4de9[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:57,829 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-07 10:54:57,829 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,832 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,832 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-07 10:54:57,832 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-07 10:54:57,832 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:57,832 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,832 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:57,833 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,834 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-07 10:54:57,834 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:57,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:57,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:57,834 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-07 10:54:57,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:57,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:57,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:57,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:57,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-07 10:54:57,836 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-07 10:54:57,836 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:57,836 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:57,836 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,836 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:57,838 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,838 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:57,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:57,838 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:57,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:57,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:57,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:57,839 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:57,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,840 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:57,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,843 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,843 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,843 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:57,844 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:57,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-07 10:54:57,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:57,844 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:57,844 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,844 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:57,844 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:57,844 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,844 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:57,844 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:57,844 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-07 10:54:57,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:57,844 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:57,944 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:57,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:57,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:57,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:57,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,950 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-07 10:54:57,950 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:57,951 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-07 10:54:57,951 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-07 10:54:57,951 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,951 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,952 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,953 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:57,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:57,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:57,953 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:57,953 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:57,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,953 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:57,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,954 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,954 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-07 10:54:57,954 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:57,954 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-07 10:54:57,954 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:57,954 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-07 10:54:57,954 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:57,954 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:57,954 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:57,954 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. started... 2023-03-07 10:54:57,955 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b1d149d88d390744a8d9cafdd3682b43 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:58,368 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907ecea31d612ea4c1aab2ad410ebcee68d to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907ecea31d612ea4c1aab2ad410ebcee68d 2023-03-07 10:54:58,374 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/.tmp/family1/6030564169184a0789b542bcae2c0f9e 2023-03-07 10:54:58,386 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/.tmp/family1/6030564169184a0789b542bcae2c0f9e as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/6030564169184a0789b542bcae2c0f9e 2023-03-07 10:54:58,390 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/6030564169184a0789b542bcae2c0f9e, entries=1, sequenceid=37, filesize=5.0 K 2023-03-07 10:54:58,391 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b1d149d88d390744a8d9cafdd3682b43 in 436ms, sequenceid=37, compaction requested=true 2023-03-07 10:54:58,391 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b1d149d88d390744a8d9cafdd3682b43: 2023-03-07 10:54:58,391 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:58,391 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:58,391 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:58,391 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:58,391 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-07 10:54:58,391 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-07 10:54:58,393 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:58,393 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:58,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:58,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:58,393 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,393 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:58,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:58,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:58,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:58,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:58,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-07 10:54:58,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3592bcee[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:58,394 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-07 10:54:58,394 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,397 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,397 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-07 10:54:58,397 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-07 10:54:58,397 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:58,397 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:58,397 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:58,398 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-07 10:54:58,398 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:58,398 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:58,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:58,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:58,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:58,398 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-07 10:54:58,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:58,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:58,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:58,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:58,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:58,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:58,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-07 10:54:58,401 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-07 10:54:58,401 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:58,401 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:58,401 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,401 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:58,403 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,403 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:58,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:58,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,403 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:58,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:58,403 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:58,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:58,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:58,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:58,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,404 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:58,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:58,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:58,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:58,406 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:58,406 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:58,406 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,406 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,406 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:58,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:58,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-07 10:54:58,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:58,406 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:58,406 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:58,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:58,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-07 10:54:58,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:58,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:58,407 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,407 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:58,407 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,407 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:58,407 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,507 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:58,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:58,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:54:58,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-07 10:54:58,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,513 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-07 10:54:58,513 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:58,513 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-07 10:54:58,513 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-07 10:54:58,514 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,514 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,516 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:58,516 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:58,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:58,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:58,517 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:58,517 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:54:58,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,517 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:54:58,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,517 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,518 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-07 10:54:58,518 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:58,518 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-07 10:54:58,518 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:54:58,518 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-07 10:54:58,518 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:54:58,518 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:54:58,518 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:58,518 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. started... 2023-03-07 10:54:58,518 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b1d149d88d390744a8d9cafdd3682b43 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:54:58,936 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112017b54ce436844a728c0e600f92662dd3 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112017b54ce436844a728c0e600f92662dd3 2023-03-07 10:54:59,341 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/.tmp/family1/fd6d3160e84b47c7947a0520ad013471 2023-03-07 10:54:59,345 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/.tmp/family1/fd6d3160e84b47c7947a0520ad013471 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/fd6d3160e84b47c7947a0520ad013471 2023-03-07 10:54:59,348 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/fd6d3160e84b47c7947a0520ad013471, entries=1, sequenceid=41, filesize=5.0 K 2023-03-07 10:54:59,349 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b1d149d88d390744a8d9cafdd3682b43 in 831ms, sequenceid=41, compaction requested=true 2023-03-07 10:54:59,349 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b1d149d88d390744a8d9cafdd3682b43: 2023-03-07 10:54:59,349 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:59,349 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:54:59,349 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:54:59,349 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:59,350 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-07 10:54:59,350 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-07 10:54:59,351 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:59,351 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:59,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:59,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:59,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:59,351 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:59,351 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:54:59,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:59,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:59,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:59,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:59,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:59,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-07 10:54:59,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@386b38a8[Count = 0] remaining members to acquire global barrier 2023-03-07 10:54:59,353 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-07 10:54:59,353 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:59,354 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:59,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:59,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:59,354 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-07 10:54:59,354 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-07 10:54:59,354 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:59,354 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:54:59,354 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:54:59,355 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:59,355 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-07 10:54:59,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:59,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:59,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:59,355 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:59,355 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-07 10:54:59,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:59,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:59,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:59,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:59,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:59,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:59,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:59,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:54:59,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-07 10:54:59,357 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-07 10:54:59,357 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:54:59,357 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:54:59,357 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:59,357 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:54:59,360 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:59,360 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:59,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:59,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:54:59,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:54:59,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:59,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:59,360 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:59,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:54:59,360 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:59,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:59,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:59,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:59,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:59,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:54:59,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:59,361 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:59,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:59,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:54:59,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:59,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:59,363 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:59,363 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:54:59,363 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:59,363 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:54:59,363 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:59,363 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:54:59,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:54:59,363 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:54:59,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-07 10:54:59,364 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:59,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:54:59,364 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:59,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:54:59,364 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:59,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:54:59,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:54:59,364 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-07 10:54:59,364 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:54:59,464 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:54:59,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:54:59,466 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45579] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:54:59,468 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-07 10:54:59,469 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-07 10:54:59,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:54:59,469 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678187099469 2023-03-07 10:54:59,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-07 10:54:59,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-07 10:54:59,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-07 10:54:59,472 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] zookeeper.ReadOnlyZKClient(139): Connect 0x3f3795ff to 127.0.0.1:56055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-07 10:54:59,477 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74f63962, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-07 10:54:59,477 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-07 10:54:59,909 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c8bfecafcec14f84a188215f7dcdcd43 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103c8bfecafcec14f84a188215f7dcdcd43 2023-03-07 10:54:59,910 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-07 10:54:59,923 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-07 10:54:59,924 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35410, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-07 10:54:59,931 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-07 10:54:59,932 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57164, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-07 10:54:59,941 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/24ef68de8ec04758a3885292f355cd34 first=Optional[r3] last=Optional[r6] 2023-03-07 10:54:59,941 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/24ef68de8ec04758a3885292f355cd34}] 2023-03-07 10:54:59,945 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/24ef68de8ec04758a3885292f355cd34 for inclusion in b1d149d88d390744a8d9cafdd3682b43/family1 2023-03-07 10:54:59,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-07 10:54:59,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(777): Region bounds: first= last= 2023-03-07 10:54:59,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for b1d149d88d390744a8d9cafdd3682b43: 2023-03-07 10:54:59,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/24ef68de8ec04758a3885292f355cd34 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__dou519mr6ecmj6nqh198mn7gej09akcbam4cve81vsgi5217ar2jcqghlbfo6bos/family1/24ef68de8ec04758a3885292f355cd34 2023-03-07 10:54:59,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__dou519mr6ecmj6nqh198mn7gej09akcbam4cve81vsgi5217ar2jcqghlbfo6bos/family1/24ef68de8ec04758a3885292f355cd34 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/7b0b77756d104323bf48833898ef298e_SeqId_44_ 2023-03-07 10:54:59,950 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__dou519mr6ecmj6nqh198mn7gej09akcbam4cve81vsgi5217ar2jcqghlbfo6bos/family1/24ef68de8ec04758a3885292f355cd34 into b1d149d88d390744a8d9cafdd3682b43/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/7b0b77756d104323bf48833898ef298e_SeqId_44_ - updating store file list. 2023-03-07 10:54:59,956 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/7b0b77756d104323bf48833898ef298e_SeqId_44_ into b1d149d88d390744a8d9cafdd3682b43/family1 2023-03-07 10:54:59,956 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__dou519mr6ecmj6nqh198mn7gej09akcbam4cve81vsgi5217ar2jcqghlbfo6bos/family1/24ef68de8ec04758a3885292f355cd34 into b1d149d88d390744a8d9cafdd3682b43/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/7b0b77756d104323bf48833898ef298e_SeqId_44_) 2023-03-07 10:54:59,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__dou519mr6ecmj6nqh198mn7gej09akcbam4cve81vsgi5217ar2jcqghlbfo6bos/family1/24ef68de8ec04758a3885292f355cd34 2023-03-07 10:54:59,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-07 10:54:59,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-07 10:54:59,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(1912): b1d149d88d390744a8d9cafdd3682b43/family1 is initiating minor compaction 2023-03-07 10:54:59,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@493acd2d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:54:59,960 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b1d149d88d390744a8d9cafdd3682b43/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:54:59,960 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/7979edb0ae0a4bb4942206ccb8bcdde5, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/2bed810caccc4a71a2997cb1d57fa5fa, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/d0fa86edb35e4bd28cce31c427a04375, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/3334296a85384722af56ce8e8b2c3a48, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/a432840aa36847afa0a83d4b7ad50cda, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/ce8ff03557724a5890a05ea926f2612e, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/2b010cf0011f41ba90f03a7edeb8f4d3, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/6030564169184a0789b542bcae2c0f9e, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/fd6d3160e84b47c7947a0520ad013471, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/7b0b77756d104323bf48833898ef298e_SeqId_44_] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/.tmp, totalSize=50.3 K 2023-03-07 10:54:59,960 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 7979edb0ae0a4bb4942206ccb8bcdde5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-07 10:54:59,961 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 2bed810caccc4a71a2997cb1d57fa5fa, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-07 10:54:59,961 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting d0fa86edb35e4bd28cce31c427a04375, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-07 10:54:59,961 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 3334296a85384722af56ce8e8b2c3a48, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-07 10:54:59,961 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting a432840aa36847afa0a83d4b7ad50cda, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-07 10:54:59,961 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting ce8ff03557724a5890a05ea926f2612e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-07 10:54:59,961 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 2b010cf0011f41ba90f03a7edeb8f4d3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-07 10:54:59,961 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 6030564169184a0789b542bcae2c0f9e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-07 10:54:59,961 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting fd6d3160e84b47c7947a0520ad013471, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-07 10:54:59,961 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 7b0b77756d104323bf48833898ef298e_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-07 10:54:59,962 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-07 10:54:59,963 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:54:59,965 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228185ec79ea9414606966af255d7f5ebe1 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228185ec79ea9414606966af255d7f5ebe1 2023-03-07 10:54:59,968 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231f8d4a9c0c18a49c4be344a19f3c012c2 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231f8d4a9c0c18a49c4be344a19f3c012c2 2023-03-07 10:54:59,969 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601016ad2b1d4582c442fb1fb2cbf514d9524 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601016ad2b1d4582c442fb1fb2cbf514d9524 2023-03-07 10:54:59,970 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601038f0c24d4a2894b469baf620632febe71 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601038f0c24d4a2894b469baf620632febe71 2023-03-07 10:54:59,971 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-03-07 10:54:59,971 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-07 10:54:59,971 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-07 10:54:59,972 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-07 10:54:59,972 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-07 10:54:59,972 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-07 10:54:59,972 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-07 10:54:59,972 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-07 10:54:59,972 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-07 10:54:59,972 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-07 10:55:00,006 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] throttle.PressureAwareThroughputController(145): b1d149d88d390744a8d9cafdd3682b43#family1#compaction#73 average throughput is 1.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:55:00,441 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/.tmp/family1/d3b79fe3b0e5425ea8c411556e8b5ca5 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/d3b79fe3b0e5425ea8c411556e8b5ca5 2023-03-07 10:55:00,445 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in b1d149d88d390744a8d9cafdd3682b43/family1 of b1d149d88d390744a8d9cafdd3682b43 into d3b79fe3b0e5425ea8c411556e8b5ca5(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-07 10:55:00,446 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b1d149d88d390744a8d9cafdd3682b43: 2023-03-07 10:55:00,446 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1678186499960; duration=0sec 2023-03-07 10:55:00,446 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:55:00,476 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/7979edb0ae0a4bb4942206ccb8bcdde5, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/2bed810caccc4a71a2997cb1d57fa5fa, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/d0fa86edb35e4bd28cce31c427a04375, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/3334296a85384722af56ce8e8b2c3a48, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/a432840aa36847afa0a83d4b7ad50cda, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/ce8ff03557724a5890a05ea926f2612e, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/2b010cf0011f41ba90f03a7edeb8f4d3, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/6030564169184a0789b542bcae2c0f9e, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/fd6d3160e84b47c7947a0520ad013471, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/7b0b77756d104323bf48833898ef298e_SeqId_44_] to archive 2023-03-07 10:55:00,478 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:00,480 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/7979edb0ae0a4bb4942206ccb8bcdde5 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/7979edb0ae0a4bb4942206ccb8bcdde5 2023-03-07 10:55:00,481 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/2bed810caccc4a71a2997cb1d57fa5fa to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/2bed810caccc4a71a2997cb1d57fa5fa 2023-03-07 10:55:00,482 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/d0fa86edb35e4bd28cce31c427a04375 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/d0fa86edb35e4bd28cce31c427a04375 2023-03-07 10:55:00,484 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/3334296a85384722af56ce8e8b2c3a48 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/3334296a85384722af56ce8e8b2c3a48 2023-03-07 10:55:00,486 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/a432840aa36847afa0a83d4b7ad50cda to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/a432840aa36847afa0a83d4b7ad50cda 2023-03-07 10:55:00,487 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/ce8ff03557724a5890a05ea926f2612e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/ce8ff03557724a5890a05ea926f2612e 2023-03-07 10:55:00,488 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/2b010cf0011f41ba90f03a7edeb8f4d3 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/2b010cf0011f41ba90f03a7edeb8f4d3 2023-03-07 10:55:00,489 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/6030564169184a0789b542bcae2c0f9e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/6030564169184a0789b542bcae2c0f9e 2023-03-07 10:55:00,490 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/fd6d3160e84b47c7947a0520ad013471 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/fd6d3160e84b47c7947a0520ad013471 2023-03-07 10:55:00,491 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/7b0b77756d104323bf48833898ef298e_SeqId_44_ to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/7b0b77756d104323bf48833898ef298e_SeqId_44_ 2023-03-07 10:55:00,842 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205853e7db717cf4490a0b611c27f605fce to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205853e7db717cf4490a0b611c27f605fce 2023-03-07 10:55:00,843 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-07 10:55:00,866 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0166f4cde0cc442fb4f7443e3bc73e44 first=Optional[r00] last=Optional[r2] 2023-03-07 10:55:00,867 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0166f4cde0cc442fb4f7443e3bc73e44}] 2023-03-07 10:55:00,869 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0166f4cde0cc442fb4f7443e3bc73e44 for inclusion in b1d149d88d390744a8d9cafdd3682b43/family1 2023-03-07 10:55:00,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-07 10:55:00,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(777): Region bounds: first= last= 2023-03-07 10:55:00,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for b1d149d88d390744a8d9cafdd3682b43: 2023-03-07 10:55:00,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0166f4cde0cc442fb4f7443e3bc73e44 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__9ug9sc2nv6a9nvhgh7ltp33661c159h0dno3ukj53n1krfp88rs6a53fagdsbmbr/family1/0166f4cde0cc442fb4f7443e3bc73e44 2023-03-07 10:55:00,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__9ug9sc2nv6a9nvhgh7ltp33661c159h0dno3ukj53n1krfp88rs6a53fagdsbmbr/family1/0166f4cde0cc442fb4f7443e3bc73e44 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/64e4070f8fcb40dfaa24c0e2ba90d386_SeqId_47_ 2023-03-07 10:55:00,877 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__9ug9sc2nv6a9nvhgh7ltp33661c159h0dno3ukj53n1krfp88rs6a53fagdsbmbr/family1/0166f4cde0cc442fb4f7443e3bc73e44 into b1d149d88d390744a8d9cafdd3682b43/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/64e4070f8fcb40dfaa24c0e2ba90d386_SeqId_47_ - updating store file list. 2023-03-07 10:55:00,881 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/64e4070f8fcb40dfaa24c0e2ba90d386_SeqId_47_ into b1d149d88d390744a8d9cafdd3682b43/family1 2023-03-07 10:55:00,881 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__9ug9sc2nv6a9nvhgh7ltp33661c159h0dno3ukj53n1krfp88rs6a53fagdsbmbr/family1/0166f4cde0cc442fb4f7443e3bc73e44 into b1d149d88d390744a8d9cafdd3682b43/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/64e4070f8fcb40dfaa24c0e2ba90d386_SeqId_47_) 2023-03-07 10:55:00,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__9ug9sc2nv6a9nvhgh7ltp33661c159h0dno3ukj53n1krfp88rs6a53fagdsbmbr/family1/0166f4cde0cc442fb4f7443e3bc73e44 2023-03-07 10:55:00,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-07 10:55:00,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-07 10:55:00,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(1912): b1d149d88d390744a8d9cafdd3682b43/family1 is initiating minor compaction (all files) 2023-03-07 10:55:00,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5abdd860; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:55:00,882 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b1d149d88d390744a8d9cafdd3682b43/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:55:00,882 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/f284ba9ac1f843dfb3ec293af6d647c1, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/d3b79fe3b0e5425ea8c411556e8b5ca5, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/64e4070f8fcb40dfaa24c0e2ba90d386_SeqId_47_] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/.tmp, totalSize=388.1 K 2023-03-07 10:55:00,883 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting f284ba9ac1f843dfb3ec293af6d647c1, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878838856 2023-03-07 10:55:00,883 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting d3b79fe3b0e5425ea8c411556e8b5ca5, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621238856 2023-03-07 10:55:00,884 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 64e4070f8fcb40dfaa24c0e2ba90d386_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878838856 2023-03-07 10:55:00,884 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-07 10:55:00,885 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:00,887 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130d2768749ed6c43248a7c15b3e74040ad to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130d2768749ed6c43248a7c15b3e74040ad 2023-03-07 10:55:00,888 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201dafb1bc66c544ee5b5997e3d2cf3fcab to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201dafb1bc66c544ee5b5997e3d2cf3fcab 2023-03-07 10:55:00,889 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120533979ad6718b4768a7823843e9363395 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120533979ad6718b4768a7823843e9363395 2023-03-07 10:55:00,889 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-03-07 10:55:00,889 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-07 10:55:00,890 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-07 10:55:00,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-07 10:55:00,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:55:00,891 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-07 10:55:00,893 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.4240 sec 2023-03-07 10:55:00,901 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] throttle.PressureAwareThroughputController(145): b1d149d88d390744a8d9cafdd3682b43#family1#compaction#74 average throughput is 22.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:55:00,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-07 10:55:00,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:55:01,366 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-07 10:55:01,367 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-03-07 10:55:01,367 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-07 10:55:01,369 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-03-07 10:55:01,371 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=b1d149d88d390744a8d9cafdd3682b43, REOPEN/MOVE}] 2023-03-07 10:55:01,372 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=b1d149d88d390744a8d9cafdd3682b43, REOPEN/MOVE 2023-03-07 10:55:01,372 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=b1d149d88d390744a8d9cafdd3682b43, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:01,373 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678186501372"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186501372"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186501372"}]},"ts":"1678186501372"} 2023-03-07 10:55:01,374 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure b1d149d88d390744a8d9cafdd3682b43, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:55:01,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:55:01,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b1d149d88d390744a8d9cafdd3682b43, disabling compactions & flushes 2023-03-07 10:55:01,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:55:02,118 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/.tmp/family1/b71efcbce5d4465fbe6d5d6228a7e1df as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/b71efcbce5d4465fbe6d5d6228a7e1df 2023-03-07 10:55:02,122 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in b1d149d88d390744a8d9cafdd3682b43/family1 of b1d149d88d390744a8d9cafdd3682b43 into b71efcbce5d4465fbe6d5d6228a7e1df(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-07 10:55:02,122 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b1d149d88d390744a8d9cafdd3682b43: 2023-03-07 10:55:02,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:55:02,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:55:02,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. after waiting 0 ms 2023-03-07 10:55:02,122 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1678186500882; duration=1sec 2023-03-07 10:55:02,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:55:02,122 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:55:02,127 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/f284ba9ac1f843dfb3ec293af6d647c1, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/d3b79fe3b0e5425ea8c411556e8b5ca5, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/64e4070f8fcb40dfaa24c0e2ba90d386_SeqId_47_] to archive 2023-03-07 10:55:02,127 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:02,129 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/f284ba9ac1f843dfb3ec293af6d647c1 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/f284ba9ac1f843dfb3ec293af6d647c1 2023-03-07 10:55:02,130 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/d3b79fe3b0e5425ea8c411556e8b5ca5 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/d3b79fe3b0e5425ea8c411556e8b5ca5 2023-03-07 10:55:02,131 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/64e4070f8fcb40dfaa24c0e2ba90d386_SeqId_47_ to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/64e4070f8fcb40dfaa24c0e2ba90d386_SeqId_47_ 2023-03-07 10:55:02,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-07 10:55:02,137 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:55:02,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b1d149d88d390744a8d9cafdd3682b43: 2023-03-07 10:55:02,137 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: b1d149d88d390744a8d9cafdd3682b43 to self. 2023-03-07 10:55:02,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:55:02,138 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=b1d149d88d390744a8d9cafdd3682b43, regionState=CLOSED 2023-03-07 10:55:02,138 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678186502138"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186502138"}]},"ts":"1678186502138"} 2023-03-07 10:55:02,141 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-03-07 10:55:02,141 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure b1d149d88d390744a8d9cafdd3682b43, server=jenkins-hbase4.apache.org,39673,1678186416064 in 766 msec 2023-03-07 10:55:02,141 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=b1d149d88d390744a8d9cafdd3682b43, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,39673,1678186416064; forceNewPlan=false, retain=true 2023-03-07 10:55:02,292 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=b1d149d88d390744a8d9cafdd3682b43, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:02,292 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678186502292"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186502292"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186502292"}]},"ts":"1678186502292"} 2023-03-07 10:55:02,294 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure b1d149d88d390744a8d9cafdd3682b43, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:55:02,448 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:55:02,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b1d149d88d390744a8d9cafdd3682b43, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43.', STARTKEY => '', ENDKEY => ''} 2023-03-07 10:55:02,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:55:02,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:55:02,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:55:02,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:55:02,449 INFO [StoreOpener-b1d149d88d390744a8d9cafdd3682b43-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:55:02,450 DEBUG [StoreOpener-b1d149d88d390744a8d9cafdd3682b43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1 2023-03-07 10:55:02,450 DEBUG [StoreOpener-b1d149d88d390744a8d9cafdd3682b43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1 2023-03-07 10:55:02,451 INFO [StoreOpener-b1d149d88d390744a8d9cafdd3682b43-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b1d149d88d390744a8d9cafdd3682b43 columnFamilyName family1 2023-03-07 10:55:02,455 DEBUG [StoreOpener-b1d149d88d390744a8d9cafdd3682b43-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/b71efcbce5d4465fbe6d5d6228a7e1df 2023-03-07 10:55:02,455 INFO [StoreOpener-b1d149d88d390744a8d9cafdd3682b43-1] regionserver.HStore(310): Store=b1d149d88d390744a8d9cafdd3682b43/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:55:02,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:55:02,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:55:02,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:55:02,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b1d149d88d390744a8d9cafdd3682b43; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64105468, jitterRate=-0.044754087924957275}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-07 10:55:02,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b1d149d88d390744a8d9cafdd3682b43: 2023-03-07 10:55:02,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43., pid=63, masterSystemTime=1678186502445 2023-03-07 10:55:02,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:55:02,461 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:55:02,462 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=b1d149d88d390744a8d9cafdd3682b43, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:02,462 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678186502462"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186502462"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186502462"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186502462"}]},"ts":"1678186502462"} 2023-03-07 10:55:02,464 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-03-07 10:55:02,464 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure b1d149d88d390744a8d9cafdd3682b43, server=jenkins-hbase4.apache.org,39673,1678186416064 in 169 msec 2023-03-07 10:55:02,465 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-03-07 10:55:02,465 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=b1d149d88d390744a8d9cafdd3682b43, REOPEN/MOVE in 1.0930 sec 2023-03-07 10:55:02,467 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-03-07 10:55:02,467 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.0970 sec 2023-03-07 10:55:02,468 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5120 sec 2023-03-07 10:55:02,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-03-07 10:55:02,469 INFO [Listener at localhost/42383] compactions.TestMobCompactor(278): alter status finished 2023-03-07 10:55:02,470 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45579] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:55:02,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-07 10:55:02,472 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-07 10:55:02,472 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:55:02,472 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678187102472 2023-03-07 10:55:02,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-07 10:55:02,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-07 10:55:02,474 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-07 10:55:02,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] zookeeper.ReadOnlyZKClient(139): Connect 0x45ffb306 to 127.0.0.1:56055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-07 10:55:02,478 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ed0a4a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-07 10:55:02,478 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-07 10:55:02,478 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-07 10:55:02,478 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-07 10:55:02,478 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-07 10:55:02,479 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-07 10:55:03,302 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128842f806a176f4c4a9276a462043097fb to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128842f806a176f4c4a9276a462043097fb 2023-03-07 10:55:03,303 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-07 10:55:03,315 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-07 10:55:03,316 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35418, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-07 10:55:03,322 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-07 10:55:03,323 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57168, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-07 10:55:03,331 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e84ae8910d1b4ab38bcd101a82233469 first=Optional[r05] last=Optional[r8] 2023-03-07 10:55:03,332 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=51 for row with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e84ae8910d1b4ab38bcd101a82233469}] 2023-03-07 10:55:03,335 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e84ae8910d1b4ab38bcd101a82233469 for inclusion in b1d149d88d390744a8d9cafdd3682b43/family1 2023-03-07 10:55:03,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-07 10:55:03,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(777): Region bounds: first= last= 2023-03-07 10:55:03,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for b1d149d88d390744a8d9cafdd3682b43: 2023-03-07 10:55:03,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e84ae8910d1b4ab38bcd101a82233469 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__8babuvmh1og9ecsol45grjnp00sgvup4trqfliqe12nca539f4mi0aeut96t7plh/family1/e84ae8910d1b4ab38bcd101a82233469 2023-03-07 10:55:03,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__8babuvmh1og9ecsol45grjnp00sgvup4trqfliqe12nca539f4mi0aeut96t7plh/family1/e84ae8910d1b4ab38bcd101a82233469 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/536f6d2e3d0b4ae2981c79f68ab7485e_SeqId_53_ 2023-03-07 10:55:03,341 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__8babuvmh1og9ecsol45grjnp00sgvup4trqfliqe12nca539f4mi0aeut96t7plh/family1/e84ae8910d1b4ab38bcd101a82233469 into b1d149d88d390744a8d9cafdd3682b43/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/536f6d2e3d0b4ae2981c79f68ab7485e_SeqId_53_ - updating store file list. 2023-03-07 10:55:03,344 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/536f6d2e3d0b4ae2981c79f68ab7485e_SeqId_53_ into b1d149d88d390744a8d9cafdd3682b43/family1 2023-03-07 10:55:03,344 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__8babuvmh1og9ecsol45grjnp00sgvup4trqfliqe12nca539f4mi0aeut96t7plh/family1/e84ae8910d1b4ab38bcd101a82233469 into b1d149d88d390744a8d9cafdd3682b43/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/536f6d2e3d0b4ae2981c79f68ab7485e_SeqId_53_) 2023-03-07 10:55:03,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__8babuvmh1og9ecsol45grjnp00sgvup4trqfliqe12nca539f4mi0aeut96t7plh/family1/e84ae8910d1b4ab38bcd101a82233469 2023-03-07 10:55:03,346 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-07 10:55:03,347 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:03,348 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112017b54ce436844a728c0e600f92662dd3 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112017b54ce436844a728c0e600f92662dd3 2023-03-07 10:55:03,349 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128d38684cbee1b4fb688e5cf40e3dc3da6 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128d38684cbee1b4fb688e5cf40e3dc3da6 2023-03-07 10:55:03,349 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-03-07 10:55:03,349 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-07 10:55:03,350 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-07 10:55:03,350 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-07 10:55:03,350 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-07 10:55:03,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-07 10:55:03,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:55:03,351 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-07 10:55:03,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 880 msec 2023-03-07 10:55:03,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-03-07 10:55:03,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:55:03,814 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-03-07 10:55:03,814 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-07 10:55:03,814 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-03-07 10:55:03,816 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-03-07 10:55:03,818 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=b1d149d88d390744a8d9cafdd3682b43, REOPEN/MOVE}] 2023-03-07 10:55:03,819 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=b1d149d88d390744a8d9cafdd3682b43, REOPEN/MOVE 2023-03-07 10:55:03,819 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=b1d149d88d390744a8d9cafdd3682b43, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:03,820 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678186503819"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186503819"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186503819"}]},"ts":"1678186503819"} 2023-03-07 10:55:03,821 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure b1d149d88d390744a8d9cafdd3682b43, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:55:03,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:55:03,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b1d149d88d390744a8d9cafdd3682b43, disabling compactions & flushes 2023-03-07 10:55:03,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:55:03,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:55:03,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. after waiting 0 ms 2023-03-07 10:55:03,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:55:03,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-07 10:55:03,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:55:03,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b1d149d88d390744a8d9cafdd3682b43: 2023-03-07 10:55:03,979 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: b1d149d88d390744a8d9cafdd3682b43 to self. 2023-03-07 10:55:03,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:55:03,980 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=b1d149d88d390744a8d9cafdd3682b43, regionState=CLOSED 2023-03-07 10:55:03,980 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678186503980"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186503980"}]},"ts":"1678186503980"} 2023-03-07 10:55:03,982 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-03-07 10:55:03,983 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure b1d149d88d390744a8d9cafdd3682b43, server=jenkins-hbase4.apache.org,39673,1678186416064 in 160 msec 2023-03-07 10:55:03,983 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=b1d149d88d390744a8d9cafdd3682b43, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,39673,1678186416064; forceNewPlan=false, retain=true 2023-03-07 10:55:04,133 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=b1d149d88d390744a8d9cafdd3682b43, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:04,134 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678186504133"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186504133"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186504133"}]},"ts":"1678186504133"} 2023-03-07 10:55:04,135 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure b1d149d88d390744a8d9cafdd3682b43, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:55:04,290 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:55:04,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b1d149d88d390744a8d9cafdd3682b43, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43.', STARTKEY => '', ENDKEY => ''} 2023-03-07 10:55:04,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:55:04,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:55:04,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:55:04,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:55:04,291 INFO [StoreOpener-b1d149d88d390744a8d9cafdd3682b43-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:55:04,292 DEBUG [StoreOpener-b1d149d88d390744a8d9cafdd3682b43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1 2023-03-07 10:55:04,292 DEBUG [StoreOpener-b1d149d88d390744a8d9cafdd3682b43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1 2023-03-07 10:55:04,293 INFO [StoreOpener-b1d149d88d390744a8d9cafdd3682b43-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b1d149d88d390744a8d9cafdd3682b43 columnFamilyName family1 2023-03-07 10:55:04,299 DEBUG [StoreOpener-b1d149d88d390744a8d9cafdd3682b43-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/536f6d2e3d0b4ae2981c79f68ab7485e_SeqId_53_ 2023-03-07 10:55:04,302 DEBUG [StoreOpener-b1d149d88d390744a8d9cafdd3682b43-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/family1/b71efcbce5d4465fbe6d5d6228a7e1df 2023-03-07 10:55:04,303 INFO [StoreOpener-b1d149d88d390744a8d9cafdd3682b43-1] regionserver.HStore(310): Store=b1d149d88d390744a8d9cafdd3682b43/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:55:04,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:55:04,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:55:04,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:55:04,307 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b1d149d88d390744a8d9cafdd3682b43; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62449238, jitterRate=-0.06943383812904358}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-07 10:55:04,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b1d149d88d390744a8d9cafdd3682b43: 2023-03-07 10:55:04,308 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43., pid=69, masterSystemTime=1678186504287 2023-03-07 10:55:04,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:55:04,311 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:55:04,312 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=b1d149d88d390744a8d9cafdd3682b43, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:04,312 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678186504312"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186504312"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186504312"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186504312"}]},"ts":"1678186504312"} 2023-03-07 10:55:04,314 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-03-07 10:55:04,315 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure b1d149d88d390744a8d9cafdd3682b43, server=jenkins-hbase4.apache.org,39673,1678186416064 in 178 msec 2023-03-07 10:55:04,316 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-03-07 10:55:04,316 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=b1d149d88d390744a8d9cafdd3682b43, REOPEN/MOVE in 497 msec 2023-03-07 10:55:04,318 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-03-07 10:55:04,318 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 501 msec 2023-03-07 10:55:04,319 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 914 msec 2023-03-07 10:55:04,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-03-07 10:55:04,321 INFO [Listener at localhost/42383] compactions.TestMobCompactor(278): alter status finished 2023-03-07 10:55:04,322 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45579] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-07 10:55:04,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-07 10:55:04,324 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-07 10:55:04,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:55:04,325 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678187104325 2023-03-07 10:55:04,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-07 10:55:04,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-07 10:55:04,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-07 10:55:04,327 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] zookeeper.ReadOnlyZKClient(139): Connect 0x2fc6f9e3 to 127.0.0.1:56055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-07 10:55:04,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23102aec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-07 10:55:04,333 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-07 10:55:04,333 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-07 10:55:04,333 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-07 10:55:04,333 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-07 10:55:04,333 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-07 10:55:04,333 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-07 10:55:04,333 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-07 10:55:04,333 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-07 10:55:04,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-07 10:55:04,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:55:04,334 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-07 10:55:04,335 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 12 msec 2023-03-07 10:55:04,385 INFO [Listener at localhost/42383] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=244 (was 243) - Thread LEAK? -, OpenFileDescriptor=632 (was 606) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=186 (was 210), ProcessCount=171 (was 171), AvailableMemoryMB=9489 (was 9498) 2023-03-07 10:55:04,399 INFO [Listener at localhost/42383] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=244, OpenFileDescriptor=632, MaxFileDescriptor=60000, SystemLoadAverage=186, ProcessCount=171, AvailableMemoryMB=9489 2023-03-07 10:55:04,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-07 10:55:04,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-03-07 10:55:04,406 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-03-07 10:55:04,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-03-07 10:55:04,406 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-07 10:55:04,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-07 10:55:04,407 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d 2023-03-07 10:55:04,408 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d empty. 2023-03-07 10:55:04,408 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d 2023-03-07 10:55:04,408 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-03-07 10:55:04,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-07 10:55:04,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-07 10:55:04,817 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-03-07 10:55:04,818 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 39d07dcc510b7fa426c4f25ab1b7303d, NAME => 'testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp 2023-03-07 10:55:05,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-07 10:55:05,225 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:55:05,225 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 39d07dcc510b7fa426c4f25ab1b7303d, disabling compactions & flushes 2023-03-07 10:55:05,225 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d. 2023-03-07 10:55:05,225 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d. 2023-03-07 10:55:05,225 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d. after waiting 0 ms 2023-03-07 10:55:05,225 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d. 2023-03-07 10:55:05,225 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d. 2023-03-07 10:55:05,225 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 39d07dcc510b7fa426c4f25ab1b7303d: 2023-03-07 10:55:05,227 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-03-07 10:55:05,228 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678186505228"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186505228"}]},"ts":"1678186505228"} 2023-03-07 10:55:05,229 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-07 10:55:05,229 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-07 10:55:05,230 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186505230"}]},"ts":"1678186505230"} 2023-03-07 10:55:05,230 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-03-07 10:55:05,235 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=39d07dcc510b7fa426c4f25ab1b7303d, ASSIGN}] 2023-03-07 10:55:05,237 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=39d07dcc510b7fa426c4f25ab1b7303d, ASSIGN 2023-03-07 10:55:05,237 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=39d07dcc510b7fa426c4f25ab1b7303d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39673,1678186416064; forceNewPlan=false, retain=false 2023-03-07 10:55:05,388 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=39d07dcc510b7fa426c4f25ab1b7303d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:05,389 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678186505388"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186505388"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186505388"}]},"ts":"1678186505388"} 2023-03-07 10:55:05,390 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 39d07dcc510b7fa426c4f25ab1b7303d, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:55:05,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-07 10:55:05,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d. 2023-03-07 10:55:05,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 39d07dcc510b7fa426c4f25ab1b7303d, NAME => 'testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d.', STARTKEY => '', ENDKEY => ''} 2023-03-07 10:55:05,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-03-07 10:55:05,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-03-07 10:55:05,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 39d07dcc510b7fa426c4f25ab1b7303d 2023-03-07 10:55:05,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:55:05,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 39d07dcc510b7fa426c4f25ab1b7303d 2023-03-07 10:55:05,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 39d07dcc510b7fa426c4f25ab1b7303d 2023-03-07 10:55:05,548 INFO [StoreOpener-39d07dcc510b7fa426c4f25ab1b7303d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 39d07dcc510b7fa426c4f25ab1b7303d 2023-03-07 10:55:05,549 DEBUG [StoreOpener-39d07dcc510b7fa426c4f25ab1b7303d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1 2023-03-07 10:55:05,549 DEBUG [StoreOpener-39d07dcc510b7fa426c4f25ab1b7303d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1 2023-03-07 10:55:05,550 INFO [StoreOpener-39d07dcc510b7fa426c4f25ab1b7303d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 39d07dcc510b7fa426c4f25ab1b7303d columnFamilyName f1 2023-03-07 10:55:05,551 INFO [StoreOpener-39d07dcc510b7fa426c4f25ab1b7303d-1] regionserver.HStore(310): Store=39d07dcc510b7fa426c4f25ab1b7303d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:55:05,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d 2023-03-07 10:55:05,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d 2023-03-07 10:55:05,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 39d07dcc510b7fa426c4f25ab1b7303d 2023-03-07 10:55:05,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-07 10:55:05,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 39d07dcc510b7fa426c4f25ab1b7303d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68632780, jitterRate=0.022708117961883545}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-07 10:55:05,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 39d07dcc510b7fa426c4f25ab1b7303d: 2023-03-07 10:55:05,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d., pid=73, masterSystemTime=1678186505542 2023-03-07 10:55:05,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d. 2023-03-07 10:55:05,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d. 2023-03-07 10:55:05,558 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=39d07dcc510b7fa426c4f25ab1b7303d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:05,558 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678186505558"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186505558"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186505558"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186505558"}]},"ts":"1678186505558"} 2023-03-07 10:55:05,560 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-03-07 10:55:05,560 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 39d07dcc510b7fa426c4f25ab1b7303d, server=jenkins-hbase4.apache.org,39673,1678186416064 in 169 msec 2023-03-07 10:55:05,562 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-03-07 10:55:05,562 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=39d07dcc510b7fa426c4f25ab1b7303d, ASSIGN in 325 msec 2023-03-07 10:55:05,562 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-07 10:55:05,562 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186505562"}]},"ts":"1678186505562"} 2023-03-07 10:55:05,563 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-03-07 10:55:05,565 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-03-07 10:55:05,566 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1620 sec 2023-03-07 10:55:06,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-07 10:55:06,512 INFO [Listener at localhost/42383] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-03-07 10:55:06,512 DEBUG [Listener at localhost/42383] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-03-07 10:55:06,514 INFO [Listener at localhost/42383] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-03-07 10:55:06,518 INFO [Listener at localhost/42383] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-03-07 10:55:06,518 INFO [Listener at localhost/42383] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-03-07 10:55:06,519 INFO [Listener at localhost/42383] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-03-07 10:55:06,523 INFO [Listener at localhost/42383] regionserver.HRegion(2745): Flushing 39d07dcc510b7fa426c4f25ab1b7303d 1/1 column families, dataSize=37 B heapSize=368 B 2023-03-07 10:55:06,936 INFO [Listener at localhost/42383] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303071e2ff7edee7b4414aacebbd919fb6e12 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303071e2ff7edee7b4414aacebbd919fb6e12 2023-03-07 10:55:07,341 INFO [Listener at localhost/42383] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/.tmp/f1/e1756607996f4e729750151f3798de4e 2023-03-07 10:55:07,346 DEBUG [Listener at localhost/42383] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/.tmp/f1/e1756607996f4e729750151f3798de4e as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e 2023-03-07 10:55:07,350 INFO [Listener at localhost/42383] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e, entries=1, sequenceid=5, filesize=4.9 K 2023-03-07 10:55:07,351 INFO [Listener at localhost/42383] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 39d07dcc510b7fa426c4f25ab1b7303d in 828ms, sequenceid=5, compaction requested=false 2023-03-07 10:55:07,351 DEBUG [Listener at localhost/42383] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-03-07 10:55:07,351 DEBUG [Listener at localhost/42383] regionserver.HRegion(2446): Flush status journal for 39d07dcc510b7fa426c4f25ab1b7303d: 2023-03-07 10:55:07,353 INFO [Listener at localhost/42383] regionserver.HRegion(2745): Flushing 39d07dcc510b7fa426c4f25ab1b7303d 1/1 column families, dataSize=37 B heapSize=368 B 2023-03-07 10:55:07,683 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-07 10:55:07,765 INFO [Listener at localhost/42383] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230307baa2a66fcef846c18993a4d9760a469f to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230307baa2a66fcef846c18993a4d9760a469f 2023-03-07 10:55:08,171 INFO [Listener at localhost/42383] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/.tmp/f1/4a2a5ea5379442a08ff8da7f6a3e08ab 2023-03-07 10:55:08,175 DEBUG [Listener at localhost/42383] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/.tmp/f1/4a2a5ea5379442a08ff8da7f6a3e08ab as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab 2023-03-07 10:55:08,180 INFO [Listener at localhost/42383] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab, entries=1, sequenceid=9, filesize=4.9 K 2023-03-07 10:55:08,181 INFO [Listener at localhost/42383] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 39d07dcc510b7fa426c4f25ab1b7303d in 828ms, sequenceid=9, compaction requested=false 2023-03-07 10:55:08,181 DEBUG [Listener at localhost/42383] regionserver.HRegion(2446): Flush status journal for 39d07dcc510b7fa426c4f25ab1b7303d: 2023-03-07 10:55:08,182 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45579] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-03-07 10:55:08,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-07 10:55:08,184 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-07 10:55:08,184 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:55:08,184 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678187108184 2023-03-07 10:55:08,185 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-07 10:55:08,185 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-03-07 10:55:08,185 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-03-07 10:55:08,185 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] zookeeper.ReadOnlyZKClient(139): Connect 0x735186fa to 127.0.0.1:56055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-07 10:55:08,190 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51b48536, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-07 10:55:08,190 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230307 for table='testGetAfterCompaction' and column='f1' 2023-03-07 10:55:08,233 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,233 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,284 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,284 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,335 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,335 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,386 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,386 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,437 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,437 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,488 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,488 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,539 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,539 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,590 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,590 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,641 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,641 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,692 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,692 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,743 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,743 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,794 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,794 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,845 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,845 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,896 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,896 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,947 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,947 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,998 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:08,998 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,018 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303073ccfba53990640a6b78a30c69703b693 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303073ccfba53990640a6b78a30c69703b693 2023-03-07 10:55:09,019 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230307 table='testGetAfterCompaction' column='f1' 2023-03-07 10:55:09,031 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-07 10:55:09,033 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60180, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-07 10:55:09,039 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-07 10:55:09,040 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51290, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-07 10:55:09,048 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230307/f1/84ddd4ede58443eba203ba18304a2cdd first=Optional[r1] last=Optional[r2] 2023-03-07 10:55:09,049 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,049 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=2 for row with hfile group [{f1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230307/f1/84ddd4ede58443eba203ba18304a2cdd}] 2023-03-07 10:55:09,049 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,052 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230307/f1/84ddd4ede58443eba203ba18304a2cdd for inclusion in 39d07dcc510b7fa426c4f25ab1b7303d/f1 2023-03-07 10:55:09,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-03-07 10:55:09,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(777): Region bounds: first= last= 2023-03-07 10:55:09,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for 39d07dcc510b7fa426c4f25ab1b7303d: 2023-03-07 10:55:09,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230307/f1/84ddd4ede58443eba203ba18304a2cdd to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testGetAfterCompaction__lmctigm049495j6pvjgn5a3mel5064gdkocscaib3qmi00creaee66hqpof5vibs/f1/84ddd4ede58443eba203ba18304a2cdd 2023-03-07 10:55:09,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testGetAfterCompaction__lmctigm049495j6pvjgn5a3mel5064gdkocscaib3qmi00creaee66hqpof5vibs/f1/84ddd4ede58443eba203ba18304a2cdd as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/8cd0ab9ade02496c807aa50b87bd359d_SeqId_12_ 2023-03-07 10:55:09,058 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testGetAfterCompaction__lmctigm049495j6pvjgn5a3mel5064gdkocscaib3qmi00creaee66hqpof5vibs/f1/84ddd4ede58443eba203ba18304a2cdd into 39d07dcc510b7fa426c4f25ab1b7303d/f1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/8cd0ab9ade02496c807aa50b87bd359d_SeqId_12_ - updating store file list. 2023-03-07 10:55:09,060 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/8cd0ab9ade02496c807aa50b87bd359d_SeqId_12_ into 39d07dcc510b7fa426c4f25ab1b7303d/f1 2023-03-07 10:55:09,060 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testGetAfterCompaction__lmctigm049495j6pvjgn5a3mel5064gdkocscaib3qmi00creaee66hqpof5vibs/f1/84ddd4ede58443eba203ba18304a2cdd into 39d07dcc510b7fa426c4f25ab1b7303d/f1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/8cd0ab9ade02496c807aa50b87bd359d_SeqId_12_) 2023-03-07 10:55:09,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testGetAfterCompaction__lmctigm049495j6pvjgn5a3mel5064gdkocscaib3qmi00creaee66hqpof5vibs/f1/84ddd4ede58443eba203ba18304a2cdd 2023-03-07 10:55:09,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(1912): 39d07dcc510b7fa426c4f25ab1b7303d/f1 is initiating minor compaction 2023-03-07 10:55:09,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@574b9ff4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:55:09,061 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 39d07dcc510b7fa426c4f25ab1b7303d/f1 in testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d. 2023-03-07 10:55:09,061 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/8cd0ab9ade02496c807aa50b87bd359d_SeqId_12_] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/.tmp, totalSize=10.0 K 2023-03-07 10:55:09,061 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 4a2a5ea5379442a08ff8da7f6a3e08ab, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-07 10:55:09,061 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 8cd0ab9ade02496c807aa50b87bd359d_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-07 10:55:09,063 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230307 table='testGetAfterCompaction' column='f1' 2023-03-07 10:55:09,064 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:09,065 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303071e2ff7edee7b4414aacebbd919fb6e12 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303071e2ff7edee7b4414aacebbd919fb6e12 2023-03-07 10:55:09,067 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230307baa2a66fcef846c18993a4d9760a469f to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230307baa2a66fcef846c18993a4d9760a469f 2023-03-07 10:55:09,067 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-03-07 10:55:09,067 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230307' 2023-03-07 10:55:09,067 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230307 for table='testGetAfterCompaction' and column='f1' 2023-03-07 10:55:09,067 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-03-07 10:55:09,067 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:55:09,068 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-07 10:55:09,070 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 887 msec 2023-03-07 10:55:09,070 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] throttle.PressureAwareThroughputController(145): 39d07dcc510b7fa426c4f25ab1b7303d#f1#compaction#77 average throughput is 0.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:55:09,100 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,100 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/8cd0ab9ade02496c807aa50b87bd359d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678186509014; access_time=1678186508200; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-07 10:55:09,100 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,103 DEBUG [Listener at localhost/42383] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-07 10:55:09,107 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60194, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-07 10:55:09,107 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39673] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d. 2023-03-07 10:55:09,107 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39673] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-03-07 10:55:09,107 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39673] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-07 10:55:09,108 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39673] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-07 10:55:09,108 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39673] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d. because compaction request was cancelled 2023-03-07 10:55:09,159 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,159 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/8cd0ab9ade02496c807aa50b87bd359d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678186509014; access_time=1678186508200; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-07 10:55:09,159 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,210 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,210 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/8cd0ab9ade02496c807aa50b87bd359d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678186509014; access_time=1678186508200; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-07 10:55:09,210 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,261 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,261 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/8cd0ab9ade02496c807aa50b87bd359d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678186509014; access_time=1678186508200; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-07 10:55:09,261 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,312 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,312 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/8cd0ab9ade02496c807aa50b87bd359d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678186509014; access_time=1678186508200; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-07 10:55:09,312 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,363 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,363 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/8cd0ab9ade02496c807aa50b87bd359d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678186509014; access_time=1678186508200; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-07 10:55:09,363 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,414 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,414 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/8cd0ab9ade02496c807aa50b87bd359d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678186509014; access_time=1678186508200; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-07 10:55:09,414 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,465 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,465 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/8cd0ab9ade02496c807aa50b87bd359d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678186509014; access_time=1678186508200; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-07 10:55:09,465 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,516 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,516 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/8cd0ab9ade02496c807aa50b87bd359d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678186509014; access_time=1678186508200; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-07 10:55:09,516 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,567 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,567 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/8cd0ab9ade02496c807aa50b87bd359d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678186509014; access_time=1678186508200; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-07 10:55:09,567 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,618 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,618 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/8cd0ab9ade02496c807aa50b87bd359d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678186509014; access_time=1678186508200; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-07 10:55:09,618 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,669 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,669 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/8cd0ab9ade02496c807aa50b87bd359d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678186509014; access_time=1678186508200; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-07 10:55:09,669 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,720 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,720 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/8cd0ab9ade02496c807aa50b87bd359d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678186509014; access_time=1678186508200; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-07 10:55:09,720 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,771 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,771 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/8cd0ab9ade02496c807aa50b87bd359d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678186509014; access_time=1678186508200; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-07 10:55:09,771 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,822 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,822 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/8cd0ab9ade02496c807aa50b87bd359d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678186509014; access_time=1678186508200; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-07 10:55:09,822 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,873 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,873 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/8cd0ab9ade02496c807aa50b87bd359d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678186509014; access_time=1678186508200; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-07 10:55:09,873 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,883 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/.tmp/f1/e0dfa36a57cf4ccda402fbd88765bfd0 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e0dfa36a57cf4ccda402fbd88765bfd0 2023-03-07 10:55:09,888 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 39d07dcc510b7fa426c4f25ab1b7303d/f1 of 39d07dcc510b7fa426c4f25ab1b7303d into e0dfa36a57cf4ccda402fbd88765bfd0(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-07 10:55:09,888 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 39d07dcc510b7fa426c4f25ab1b7303d: 2023-03-07 10:55:09,888 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1678186509061; duration=0sec 2023-03-07 10:55:09,888 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:55:09,924 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186508171; access_time=1678186507354; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,924 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/8cd0ab9ade02496c807aa50b87bd359d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678186509014; access_time=1678186508200; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-07 10:55:09,924 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e0dfa36a57cf4ccda402fbd88765bfd0; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1678186509879; access_time=1678186509067; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,924 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,969 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/8cd0ab9ade02496c807aa50b87bd359d_SeqId_12_] to archive 2023-03-07 10:55:09,970 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:09,972 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/4a2a5ea5379442a08ff8da7f6a3e08ab 2023-03-07 10:55:09,973 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/8cd0ab9ade02496c807aa50b87bd359d_SeqId_12_ to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/8cd0ab9ade02496c807aa50b87bd359d_SeqId_12_ 2023-03-07 10:55:09,975 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e0dfa36a57cf4ccda402fbd88765bfd0; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1678186509879; access_time=1678186509067; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:09,975 INFO [Listener at localhost/42383] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678186507341; access_time=1678186506526; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-07 10:55:10,090 INFO [Listener at localhost/42383] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-03-07 10:55:10,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-03-07 10:55:10,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-03-07 10:55:10,103 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186510103"}]},"ts":"1678186510103"} 2023-03-07 10:55:10,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-07 10:55:10,104 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-03-07 10:55:10,106 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-03-07 10:55:10,108 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=39d07dcc510b7fa426c4f25ab1b7303d, UNASSIGN}] 2023-03-07 10:55:10,109 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=39d07dcc510b7fa426c4f25ab1b7303d, UNASSIGN 2023-03-07 10:55:10,109 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=39d07dcc510b7fa426c4f25ab1b7303d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:10,109 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678186510109"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186510109"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186510109"}]},"ts":"1678186510109"} 2023-03-07 10:55:10,111 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 39d07dcc510b7fa426c4f25ab1b7303d, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:55:10,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-07 10:55:10,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 39d07dcc510b7fa426c4f25ab1b7303d 2023-03-07 10:55:10,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 39d07dcc510b7fa426c4f25ab1b7303d, disabling compactions & flushes 2023-03-07 10:55:10,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d. 2023-03-07 10:55:10,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d. 2023-03-07 10:55:10,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d. after waiting 0 ms 2023-03-07 10:55:10,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d. 2023-03-07 10:55:10,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-03-07 10:55:10,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-03-07 10:55:10,268 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d. 2023-03-07 10:55:10,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 39d07dcc510b7fa426c4f25ab1b7303d: 2023-03-07 10:55:10,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 39d07dcc510b7fa426c4f25ab1b7303d 2023-03-07 10:55:10,270 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=39d07dcc510b7fa426c4f25ab1b7303d, regionState=CLOSED 2023-03-07 10:55:10,270 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678186510270"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186510270"}]},"ts":"1678186510270"} 2023-03-07 10:55:10,272 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-03-07 10:55:10,272 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 39d07dcc510b7fa426c4f25ab1b7303d, server=jenkins-hbase4.apache.org,39673,1678186416064 in 160 msec 2023-03-07 10:55:10,273 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-03-07 10:55:10,274 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=39d07dcc510b7fa426c4f25ab1b7303d, UNASSIGN in 164 msec 2023-03-07 10:55:10,274 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186510274"}]},"ts":"1678186510274"} 2023-03-07 10:55:10,275 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-03-07 10:55:10,281 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-03-07 10:55:10,282 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 185 msec 2023-03-07 10:55:10,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-07 10:55:10,406 INFO [Listener at localhost/42383] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-03-07 10:55:10,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-03-07 10:55:10,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-03-07 10:55:10,418 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-07 10:55:10,420 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-07 10:55:10,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-03-07 10:55:10,422 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d 2023-03-07 10:55:10,425 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1, FileablePath, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/recovered.edits] 2023-03-07 10:55:10,428 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e0dfa36a57cf4ccda402fbd88765bfd0 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e0dfa36a57cf4ccda402fbd88765bfd0 2023-03-07 10:55:10,430 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/f1/e1756607996f4e729750151f3798de4e 2023-03-07 10:55:10,432 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/recovered.edits/15.seqid to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d/recovered.edits/15.seqid 2023-03-07 10:55:10,433 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testGetAfterCompaction/39d07dcc510b7fa426c4f25ab1b7303d 2023-03-07 10:55:10,433 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-03-07 10:55:10,433 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-03-07 10:55:10,434 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-03-07 10:55:10,437 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303073ccfba53990640a6b78a30c69703b693 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303073ccfba53990640a6b78a30c69703b693 2023-03-07 10:55:10,437 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-03-07 10:55:10,440 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-07 10:55:10,465 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-03-07 10:55:10,467 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-03-07 10:55:10,468 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-07 10:55:10,468 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-03-07 10:55:10,468 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1678186510468"}]},"ts":"9223372036854775807"} 2023-03-07 10:55:10,470 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-03-07 10:55:10,470 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 39d07dcc510b7fa426c4f25ab1b7303d, NAME => 'testGetAfterCompaction,,1678186504403.39d07dcc510b7fa426c4f25ab1b7303d.', STARTKEY => '', ENDKEY => ''}] 2023-03-07 10:55:10,470 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-03-07 10:55:10,470 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1678186510470"}]},"ts":"9223372036854775807"} 2023-03-07 10:55:10,471 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-03-07 10:55:10,473 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-07 10:55:10,474 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 61 msec 2023-03-07 10:55:10,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-03-07 10:55:10,522 INFO [Listener at localhost/42383] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-03-07 10:55:10,535 INFO [Listener at localhost/42383] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=248 (was 244) - Thread LEAK? -, OpenFileDescriptor=616 (was 632), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=179 (was 186), ProcessCount=171 (was 171), AvailableMemoryMB=9488 (was 9489) 2023-03-07 10:55:10,545 INFO [Listener at localhost/42383] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=248, OpenFileDescriptor=616, MaxFileDescriptor=60000, SystemLoadAverage=179, ProcessCount=171, AvailableMemoryMB=9487 2023-03-07 10:55:10,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-07 10:55:10,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-03-07 10:55:10,549 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-03-07 10:55:10,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-03-07 10:55:10,550 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-07 10:55:10,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-07 10:55:10,552 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0 2023-03-07 10:55:10,553 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577 2023-03-07 10:55:10,553 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372 2023-03-07 10:55:10,553 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0 empty. 2023-03-07 10:55:10,553 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577 empty. 2023-03-07 10:55:10,553 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372 empty. 2023-03-07 10:55:10,553 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0 2023-03-07 10:55:10,554 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577 2023-03-07 10:55:10,554 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372 2023-03-07 10:55:10,554 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-03-07 10:55:10,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-07 10:55:10,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-07 10:55:10,963 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-03-07 10:55:10,964 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0d21772dd37bba3b2c4b78b20a3c30e0, NAME => 'testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp 2023-03-07 10:55:10,965 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => b443f7ebc46146a5bfe8850837317577, NAME => 'testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp 2023-03-07 10:55:10,966 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => f26513f1f71767bd16ace3f43fa52372, NAME => 'testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp 2023-03-07 10:55:10,981 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:55:10,981 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 0d21772dd37bba3b2c4b78b20a3c30e0, disabling compactions & flushes 2023-03-07 10:55:10,981 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:10,981 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:10,981 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. after waiting 0 ms 2023-03-07 10:55:10,981 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:10,981 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:10,981 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 0d21772dd37bba3b2c4b78b20a3c30e0: 2023-03-07 10:55:11,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-07 10:55:11,378 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:55:11,378 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:55:11,378 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing b443f7ebc46146a5bfe8850837317577, disabling compactions & flushes 2023-03-07 10:55:11,378 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing f26513f1f71767bd16ace3f43fa52372, disabling compactions & flushes 2023-03-07 10:55:11,378 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:11,378 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:11,378 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:11,378 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:11,378 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. after waiting 0 ms 2023-03-07 10:55:11,378 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:11,378 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. after waiting 0 ms 2023-03-07 10:55:11,378 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:11,378 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:11,378 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for b443f7ebc46146a5bfe8850837317577: 2023-03-07 10:55:11,378 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:11,378 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for f26513f1f71767bd16ace3f43fa52372: 2023-03-07 10:55:11,380 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-03-07 10:55:11,381 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678186511381"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186511381"}]},"ts":"1678186511381"} 2023-03-07 10:55:11,381 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678186511381"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186511381"}]},"ts":"1678186511381"} 2023-03-07 10:55:11,381 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678186511381"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186511381"}]},"ts":"1678186511381"} 2023-03-07 10:55:11,383 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-07 10:55:11,384 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-07 10:55:11,384 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186511384"}]},"ts":"1678186511384"} 2023-03-07 10:55:11,385 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-03-07 10:55:11,389 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0d21772dd37bba3b2c4b78b20a3c30e0, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b443f7ebc46146a5bfe8850837317577, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f26513f1f71767bd16ace3f43fa52372, ASSIGN}] 2023-03-07 10:55:11,391 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b443f7ebc46146a5bfe8850837317577, ASSIGN 2023-03-07 10:55:11,391 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0d21772dd37bba3b2c4b78b20a3c30e0, ASSIGN 2023-03-07 10:55:11,391 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f26513f1f71767bd16ace3f43fa52372, ASSIGN 2023-03-07 10:55:11,391 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b443f7ebc46146a5bfe8850837317577, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39673,1678186416064; forceNewPlan=false, retain=false 2023-03-07 10:55:11,391 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0d21772dd37bba3b2c4b78b20a3c30e0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39673,1678186416064; forceNewPlan=false, retain=false 2023-03-07 10:55:11,391 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f26513f1f71767bd16ace3f43fa52372, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39673,1678186416064; forceNewPlan=false, retain=false 2023-03-07 10:55:11,543 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=0d21772dd37bba3b2c4b78b20a3c30e0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:11,543 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=b443f7ebc46146a5bfe8850837317577, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:11,543 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=f26513f1f71767bd16ace3f43fa52372, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:11,543 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678186511543"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186511543"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186511543"}]},"ts":"1678186511543"} 2023-03-07 10:55:11,543 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678186511543"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186511543"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186511543"}]},"ts":"1678186511543"} 2023-03-07 10:55:11,543 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678186511543"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186511543"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186511543"}]},"ts":"1678186511543"} 2023-03-07 10:55:11,545 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=80, state=RUNNABLE; OpenRegionProcedure 0d21772dd37bba3b2c4b78b20a3c30e0, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:55:11,545 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=81, state=RUNNABLE; OpenRegionProcedure b443f7ebc46146a5bfe8850837317577, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:55:11,547 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=82, state=RUNNABLE; OpenRegionProcedure f26513f1f71767bd16ace3f43fa52372, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:55:11,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-07 10:55:11,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:11,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b443f7ebc46146a5bfe8850837317577, NAME => 'testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577.', STARTKEY => '1', ENDKEY => '2'} 2023-03-07 10:55:11,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink b443f7ebc46146a5bfe8850837317577 2023-03-07 10:55:11,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:55:11,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b443f7ebc46146a5bfe8850837317577 2023-03-07 10:55:11,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b443f7ebc46146a5bfe8850837317577 2023-03-07 10:55:11,703 INFO [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b443f7ebc46146a5bfe8850837317577 2023-03-07 10:55:11,704 DEBUG [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1 2023-03-07 10:55:11,704 DEBUG [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1 2023-03-07 10:55:11,704 INFO [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b443f7ebc46146a5bfe8850837317577 columnFamilyName family1 2023-03-07 10:55:11,705 INFO [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] regionserver.HStore(310): Store=b443f7ebc46146a5bfe8850837317577/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:55:11,705 INFO [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b443f7ebc46146a5bfe8850837317577 2023-03-07 10:55:11,706 DEBUG [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2 2023-03-07 10:55:11,706 DEBUG [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2 2023-03-07 10:55:11,707 INFO [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b443f7ebc46146a5bfe8850837317577 columnFamilyName family2 2023-03-07 10:55:11,707 INFO [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] regionserver.HStore(310): Store=b443f7ebc46146a5bfe8850837317577/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:55:11,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577 2023-03-07 10:55:11,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577 2023-03-07 10:55:11,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-07 10:55:11,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b443f7ebc46146a5bfe8850837317577 2023-03-07 10:55:11,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-07 10:55:11,714 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b443f7ebc46146a5bfe8850837317577; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66793968, jitterRate=-0.0046923160552978516}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-07 10:55:11,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b443f7ebc46146a5bfe8850837317577: 2023-03-07 10:55:11,714 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577., pid=84, masterSystemTime=1678186511698 2023-03-07 10:55:11,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:11,716 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:11,716 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:11,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f26513f1f71767bd16ace3f43fa52372, NAME => 'testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372.', STARTKEY => '2', ENDKEY => ''} 2023-03-07 10:55:11,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink f26513f1f71767bd16ace3f43fa52372 2023-03-07 10:55:11,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:55:11,716 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=b443f7ebc46146a5bfe8850837317577, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:11,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f26513f1f71767bd16ace3f43fa52372 2023-03-07 10:55:11,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f26513f1f71767bd16ace3f43fa52372 2023-03-07 10:55:11,716 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678186511716"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186511716"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186511716"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186511716"}]},"ts":"1678186511716"} 2023-03-07 10:55:11,717 INFO [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f26513f1f71767bd16ace3f43fa52372 2023-03-07 10:55:11,719 DEBUG [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1 2023-03-07 10:55:11,719 DEBUG [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1 2023-03-07 10:55:11,719 INFO [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f26513f1f71767bd16ace3f43fa52372 columnFamilyName family1 2023-03-07 10:55:11,719 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=81 2023-03-07 10:55:11,719 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=81, state=SUCCESS; OpenRegionProcedure b443f7ebc46146a5bfe8850837317577, server=jenkins-hbase4.apache.org,39673,1678186416064 in 173 msec 2023-03-07 10:55:11,720 INFO [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] regionserver.HStore(310): Store=f26513f1f71767bd16ace3f43fa52372/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:55:11,720 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b443f7ebc46146a5bfe8850837317577, ASSIGN in 331 msec 2023-03-07 10:55:11,720 INFO [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f26513f1f71767bd16ace3f43fa52372 2023-03-07 10:55:11,722 DEBUG [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2 2023-03-07 10:55:11,722 DEBUG [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2 2023-03-07 10:55:11,722 INFO [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f26513f1f71767bd16ace3f43fa52372 columnFamilyName family2 2023-03-07 10:55:11,723 INFO [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] regionserver.HStore(310): Store=f26513f1f71767bd16ace3f43fa52372/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:55:11,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372 2023-03-07 10:55:11,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372 2023-03-07 10:55:11,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-07 10:55:11,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f26513f1f71767bd16ace3f43fa52372 2023-03-07 10:55:11,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-07 10:55:11,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f26513f1f71767bd16ace3f43fa52372; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68084982, jitterRate=0.014545291662216187}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-07 10:55:11,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f26513f1f71767bd16ace3f43fa52372: 2023-03-07 10:55:11,728 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372., pid=85, masterSystemTime=1678186511698 2023-03-07 10:55:11,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:11,729 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:11,729 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:11,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0d21772dd37bba3b2c4b78b20a3c30e0, NAME => 'testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0.', STARTKEY => '', ENDKEY => '1'} 2023-03-07 10:55:11,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 0d21772dd37bba3b2c4b78b20a3c30e0 2023-03-07 10:55:11,729 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=f26513f1f71767bd16ace3f43fa52372, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:11,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:55:11,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0d21772dd37bba3b2c4b78b20a3c30e0 2023-03-07 10:55:11,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0d21772dd37bba3b2c4b78b20a3c30e0 2023-03-07 10:55:11,730 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678186511729"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186511729"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186511729"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186511729"}]},"ts":"1678186511729"} 2023-03-07 10:55:11,731 INFO [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0d21772dd37bba3b2c4b78b20a3c30e0 2023-03-07 10:55:11,732 DEBUG [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1 2023-03-07 10:55:11,732 DEBUG [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1 2023-03-07 10:55:11,732 INFO [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d21772dd37bba3b2c4b78b20a3c30e0 columnFamilyName family1 2023-03-07 10:55:11,732 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=82 2023-03-07 10:55:11,732 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=82, state=SUCCESS; OpenRegionProcedure f26513f1f71767bd16ace3f43fa52372, server=jenkins-hbase4.apache.org,39673,1678186416064 in 185 msec 2023-03-07 10:55:11,733 INFO [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] regionserver.HStore(310): Store=0d21772dd37bba3b2c4b78b20a3c30e0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:55:11,733 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f26513f1f71767bd16ace3f43fa52372, ASSIGN in 343 msec 2023-03-07 10:55:11,733 INFO [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0d21772dd37bba3b2c4b78b20a3c30e0 2023-03-07 10:55:11,734 DEBUG [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2 2023-03-07 10:55:11,734 DEBUG [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2 2023-03-07 10:55:11,734 INFO [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d21772dd37bba3b2c4b78b20a3c30e0 columnFamilyName family2 2023-03-07 10:55:11,735 INFO [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] regionserver.HStore(310): Store=0d21772dd37bba3b2c4b78b20a3c30e0/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:55:11,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0 2023-03-07 10:55:11,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0 2023-03-07 10:55:11,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-07 10:55:11,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0d21772dd37bba3b2c4b78b20a3c30e0 2023-03-07 10:55:11,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-07 10:55:11,740 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0d21772dd37bba3b2c4b78b20a3c30e0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68924513, jitterRate=0.027055278420448303}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-07 10:55:11,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0d21772dd37bba3b2c4b78b20a3c30e0: 2023-03-07 10:55:11,741 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0., pid=83, masterSystemTime=1678186511698 2023-03-07 10:55:11,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:11,742 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:11,742 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=0d21772dd37bba3b2c4b78b20a3c30e0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:11,742 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678186511742"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186511742"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186511742"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186511742"}]},"ts":"1678186511742"} 2023-03-07 10:55:11,745 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=80 2023-03-07 10:55:11,745 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=80, state=SUCCESS; OpenRegionProcedure 0d21772dd37bba3b2c4b78b20a3c30e0, server=jenkins-hbase4.apache.org,39673,1678186416064 in 199 msec 2023-03-07 10:55:11,746 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=80, resume processing ppid=79 2023-03-07 10:55:11,746 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0d21772dd37bba3b2c4b78b20a3c30e0, ASSIGN in 357 msec 2023-03-07 10:55:11,747 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-07 10:55:11,747 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186511747"}]},"ts":"1678186511747"} 2023-03-07 10:55:11,748 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-03-07 10:55:11,750 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-03-07 10:55:11,751 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2030 sec 2023-03-07 10:55:12,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-07 10:55:12,656 INFO [Listener at localhost/42383] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-03-07 10:55:12,662 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:55:12,664 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:55:12,665 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:55:12,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:55:12,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-07 10:55:12,669 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-07 10:55:12,669 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:55:12,670 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-07 10:55:12,670 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-07 10:55:12,670 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:12,670 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-07 10:55:12,675 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:12,675 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:55:12,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:55:12,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:55:12,675 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:12,675 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:55:12,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-07 10:55:12,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:12,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:55:12,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-07 10:55:12,676 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-07 10:55:12,676 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-07 10:55:12,676 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-07 10:55:12,676 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:55:12,676 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-07 10:55:12,676 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:12,677 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-07 10:55:12,677 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:55:12,677 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:12,677 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. started... 2023-03-07 10:55:12,677 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. started... 2023-03-07 10:55:12,677 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:12,677 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. started... 2023-03-07 10:55:12,677 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b443f7ebc46146a5bfe8850837317577 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-07 10:55:12,677 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f26513f1f71767bd16ace3f43fa52372 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-07 10:55:12,678 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0d21772dd37bba3b2c4b78b20a3c30e0 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-07 10:55:12,692 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230307bbd158cb8f784e08b5c8039b606cfbf2 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230307bbd158cb8f784e08b5c8039b606cfbf2 2023-03-07 10:55:13,092 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303073736dae9f7044ad8aebf6ed5bd19ceb6 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303073736dae9f7044ad8aebf6ed5bd19ceb6 2023-03-07 10:55:13,092 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230307113ba20ec7aa40c1a7dedda473e727ef to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230307113ba20ec7aa40c1a7dedda473e727ef 2023-03-07 10:55:13,097 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp/family1/0fea123d4fd84d19af0a53225aafe303 2023-03-07 10:55:13,497 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp/family1/385bfcef9cf24048be847a094f25a7ca 2023-03-07 10:55:13,498 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp/family1/cb481fb954494136b4a726a0ab103581 2023-03-07 10:55:13,511 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023030729d55aea989b444285ab12d6b89d38eb to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023030729d55aea989b444285ab12d6b89d38eb 2023-03-07 10:55:13,511 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230307740266b3b3b24e0f89807c29dff13c8f to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230307740266b3b3b24e0f89807c29dff13c8f 2023-03-07 10:55:13,515 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp/family2/f70d3690b0f447b49db6d7eb03105784 2023-03-07 10:55:13,518 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp/family1/0fea123d4fd84d19af0a53225aafe303 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/0fea123d4fd84d19af0a53225aafe303 2023-03-07 10:55:13,522 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/0fea123d4fd84d19af0a53225aafe303, entries=4, sequenceid=5, filesize=5.4 K 2023-03-07 10:55:13,522 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp/family2/f70d3690b0f447b49db6d7eb03105784 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/f70d3690b0f447b49db6d7eb03105784 2023-03-07 10:55:13,525 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/f70d3690b0f447b49db6d7eb03105784, entries=2, sequenceid=5, filesize=5.1 K 2023-03-07 10:55:13,526 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for f26513f1f71767bd16ace3f43fa52372 in 849ms, sequenceid=5, compaction requested=false 2023-03-07 10:55:13,526 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-03-07 10:55:13,526 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f26513f1f71767bd16ace3f43fa52372: 2023-03-07 10:55:13,526 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:13,526 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-07 10:55:13,912 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230307cf8659d6b6dd45728cb137d0b2624478 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230307cf8659d6b6dd45728cb137d0b2624478 2023-03-07 10:55:13,916 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp/family2/155cce75e6a1420499a693f041db2a8a 2023-03-07 10:55:13,920 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp/family1/cb481fb954494136b4a726a0ab103581 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/cb481fb954494136b4a726a0ab103581 2023-03-07 10:55:13,923 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/cb481fb954494136b4a726a0ab103581, entries=4, sequenceid=5, filesize=5.4 K 2023-03-07 10:55:13,924 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp/family2/155cce75e6a1420499a693f041db2a8a as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/155cce75e6a1420499a693f041db2a8a 2023-03-07 10:55:13,927 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/155cce75e6a1420499a693f041db2a8a, entries=2, sequenceid=5, filesize=5.1 K 2023-03-07 10:55:13,928 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for b443f7ebc46146a5bfe8850837317577 in 1251ms, sequenceid=5, compaction requested=false 2023-03-07 10:55:13,928 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b443f7ebc46146a5bfe8850837317577: 2023-03-07 10:55:13,928 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:13,928 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-07 10:55:14,318 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp/family2/4a61a5e4bafc4924b54fb3680d1bf155 2023-03-07 10:55:14,322 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp/family1/385bfcef9cf24048be847a094f25a7ca as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/385bfcef9cf24048be847a094f25a7ca 2023-03-07 10:55:14,326 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/385bfcef9cf24048be847a094f25a7ca, entries=4, sequenceid=5, filesize=5.4 K 2023-03-07 10:55:14,326 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp/family2/4a61a5e4bafc4924b54fb3680d1bf155 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/4a61a5e4bafc4924b54fb3680d1bf155 2023-03-07 10:55:14,329 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/4a61a5e4bafc4924b54fb3680d1bf155, entries=2, sequenceid=5, filesize=5.1 K 2023-03-07 10:55:14,330 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 0d21772dd37bba3b2c4b78b20a3c30e0 in 1652ms, sequenceid=5, compaction requested=false 2023-03-07 10:55:14,330 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0d21772dd37bba3b2c4b78b20a3c30e0: 2023-03-07 10:55:14,330 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:14,330 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-07 10:55:14,330 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-07 10:55:14,330 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:14,331 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-07 10:55:14,331 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-07 10:55:14,332 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:14,332 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:14,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:14,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:14,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:14,333 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:14,333 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:55:14,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:14,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:14,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:14,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:14,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:14,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-07 10:55:14,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69e6d82d[Count = 0] remaining members to acquire global barrier 2023-03-07 10:55:14,334 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-07 10:55:14,334 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:14,335 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:14,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:14,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:14,335 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-07 10:55:14,335 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-07 10:55:14,335 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:55:14,335 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:14,335 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:55:14,336 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:14,337 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-07 10:55:14,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:14,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:14,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:14,337 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:55:14,337 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-07 10:55:14,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:14,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:14,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:14,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:14,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:14,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:14,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:14,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:55:14,338 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-07 10:55:14,338 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-07 10:55:14,339 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:55:14,339 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:55:14,339 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-07 10:55:14,339 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:55:14,341 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:14,341 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:55:14,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:14,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:14,341 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:14,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:14,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:14,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:14,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:55:14,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:55:14,342 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:14,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:14,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:14,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:14,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:14,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:14,342 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:14,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:14,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:14,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:14,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:14,344 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:55:14,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:55:14,344 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:14,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:55:14,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-07 10:55:14,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:55:14,344 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:55:14,344 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:55:14,344 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-07 10:55:14,345 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-07 10:55:14,345 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:14,345 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:14,345 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:14,345 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:14,345 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-07 10:55:14,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:55:14,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-07 10:55:14,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:55:14,345 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:55:14,445 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:55:14,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:55:14,447 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:55:14,447 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:55:14,447 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:55:14,450 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:55:14,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-07 10:55:14,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-07 10:55:14,452 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-07 10:55:14,452 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:55:14,452 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-07 10:55:14,452 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-07 10:55:14,452 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:14,452 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-07 10:55:14,454 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:55:14,454 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:14,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:55:14,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:55:14,454 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:14,454 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:55:14,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-07 10:55:14,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:14,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:55:14,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-07 10:55:14,455 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-07 10:55:14,455 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-07 10:55:14,455 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-07 10:55:14,455 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-07 10:55:14,455 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:55:14,455 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-07 10:55:14,455 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:14,455 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. started... 2023-03-07 10:55:14,455 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:14,456 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b443f7ebc46146a5bfe8850837317577 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-07 10:55:14,455 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-07 10:55:14,456 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:55:14,456 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:14,456 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. started... 2023-03-07 10:55:14,456 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. started... 2023-03-07 10:55:14,456 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f26513f1f71767bd16ace3f43fa52372 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-07 10:55:14,456 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0d21772dd37bba3b2c4b78b20a3c30e0 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-07 10:55:14,875 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230307faa4a20384264bcab422aee73cf4231b to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230307faa4a20384264bcab422aee73cf4231b 2023-03-07 10:55:14,875 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303074776994284e2411e9710ec77eb9e8c9c to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303074776994284e2411e9710ec77eb9e8c9c 2023-03-07 10:55:14,876 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303070e1333264a4544428affb3bb698cf9ab to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303070e1333264a4544428affb3bb698cf9ab 2023-03-07 10:55:14,884 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp/family1/d21bb01241d24ac2b565a7adbdf4723e 2023-03-07 10:55:14,899 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303071003135a9b3c4d298a17bc34eada6dd9 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303071003135a9b3c4d298a17bc34eada6dd9 2023-03-07 10:55:14,904 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp/family2/ddd7d6d0122b4ae4aa75ab21a617e772 2023-03-07 10:55:14,908 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp/family1/d21bb01241d24ac2b565a7adbdf4723e as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/d21bb01241d24ac2b565a7adbdf4723e 2023-03-07 10:55:14,911 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/d21bb01241d24ac2b565a7adbdf4723e, entries=4, sequenceid=9, filesize=5.4 K 2023-03-07 10:55:14,912 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp/family2/ddd7d6d0122b4ae4aa75ab21a617e772 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/ddd7d6d0122b4ae4aa75ab21a617e772 2023-03-07 10:55:14,916 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/ddd7d6d0122b4ae4aa75ab21a617e772, entries=2, sequenceid=9, filesize=5.1 K 2023-03-07 10:55:14,917 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for b443f7ebc46146a5bfe8850837317577 in 462ms, sequenceid=9, compaction requested=false 2023-03-07 10:55:14,917 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b443f7ebc46146a5bfe8850837317577: 2023-03-07 10:55:14,917 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:14,917 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-07 10:55:15,282 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp/family1/d8c20ccc995d4822aa0a6447ed64c0ba 2023-03-07 10:55:15,287 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp/family1/b01a2447b583476cb287122573e8faba 2023-03-07 10:55:15,698 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303079a884a6968b9404aae09675031ad3bc5 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303079a884a6968b9404aae09675031ad3bc5 2023-03-07 10:55:15,705 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230307c0e1932178864f588591f3e3d65647e1 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230307c0e1932178864f588591f3e3d65647e1 2023-03-07 10:55:15,769 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-07 10:55:16,103 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp/family2/d4c9be19609b4018b7e188ac1153e94f 2023-03-07 10:55:16,107 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp/family1/d8c20ccc995d4822aa0a6447ed64c0ba as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/d8c20ccc995d4822aa0a6447ed64c0ba 2023-03-07 10:55:16,109 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp/family2/fc1ba96d8b7d4bc88a13a242f8274347 2023-03-07 10:55:16,111 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/d8c20ccc995d4822aa0a6447ed64c0ba, entries=4, sequenceid=9, filesize=5.4 K 2023-03-07 10:55:16,112 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp/family2/d4c9be19609b4018b7e188ac1153e94f as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/d4c9be19609b4018b7e188ac1153e94f 2023-03-07 10:55:16,114 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp/family1/b01a2447b583476cb287122573e8faba as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/b01a2447b583476cb287122573e8faba 2023-03-07 10:55:16,115 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/d4c9be19609b4018b7e188ac1153e94f, entries=2, sequenceid=9, filesize=5.1 K 2023-03-07 10:55:16,116 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 0d21772dd37bba3b2c4b78b20a3c30e0 in 1660ms, sequenceid=9, compaction requested=false 2023-03-07 10:55:16,116 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0d21772dd37bba3b2c4b78b20a3c30e0: 2023-03-07 10:55:16,116 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:16,116 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-07 10:55:16,118 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/b01a2447b583476cb287122573e8faba, entries=4, sequenceid=9, filesize=5.4 K 2023-03-07 10:55:16,118 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp/family2/fc1ba96d8b7d4bc88a13a242f8274347 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/fc1ba96d8b7d4bc88a13a242f8274347 2023-03-07 10:55:16,123 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/fc1ba96d8b7d4bc88a13a242f8274347, entries=2, sequenceid=9, filesize=5.1 K 2023-03-07 10:55:16,123 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for f26513f1f71767bd16ace3f43fa52372 in 1667ms, sequenceid=9, compaction requested=false 2023-03-07 10:55:16,123 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f26513f1f71767bd16ace3f43fa52372: 2023-03-07 10:55:16,123 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:16,123 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-07 10:55:16,123 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-07 10:55:16,123 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:16,124 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-07 10:55:16,124 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-07 10:55:16,125 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:16,125 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:16,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:16,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:16,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:16,126 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:16,126 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:55:16,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:16,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:16,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:16,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:16,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:16,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-07 10:55:16,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@134f13fd[Count = 0] remaining members to acquire global barrier 2023-03-07 10:55:16,127 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-07 10:55:16,127 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:16,128 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:16,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:16,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:16,128 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-07 10:55:16,128 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-07 10:55:16,128 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:55:16,128 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:16,128 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:55:16,130 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-07 10:55:16,130 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:16,130 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:55:16,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:16,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:16,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:16,130 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-07 10:55:16,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:16,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:16,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:16,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:16,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:16,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:16,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:16,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:55:16,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-07 10:55:16,132 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-07 10:55:16,132 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:55:16,132 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:55:16,132 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-07 10:55:16,132 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:55:16,134 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:16,134 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:16,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:16,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:16,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:16,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:16,134 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:55:16,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:16,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:55:16,135 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:16,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:16,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:55:16,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:16,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:16,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:16,136 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:16,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:16,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:16,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:16,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:16,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:16,138 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:16,138 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:55:16,138 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-07 10:55:16,138 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:55:16,138 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-07 10:55:16,138 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:16,138 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:55:16,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:55:16,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:55:16,138 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:16,138 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:16,138 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:16,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-07 10:55:16,138 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-07 10:55:16,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:55:16,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:55:16,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:55:16,139 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-07 10:55:16,139 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:55:16,239 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:55:16,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:55:16,241 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:55:16,241 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:55:16,242 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:55:16,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:55:16,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-07 10:55:16,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-07 10:55:16,246 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-07 10:55:16,246 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:55:16,246 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-07 10:55:16,246 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-07 10:55:16,246 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:16,246 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-07 10:55:16,248 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:16,248 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:55:16,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:55:16,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:55:16,248 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:16,248 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:55:16,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-07 10:55:16,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:16,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:55:16,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-07 10:55:16,249 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-07 10:55:16,249 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-07 10:55:16,249 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-07 10:55:16,249 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-07 10:55:16,249 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:55:16,249 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-07 10:55:16,249 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:16,249 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. started... 2023-03-07 10:55:16,249 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:16,249 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. started... 2023-03-07 10:55:16,249 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b443f7ebc46146a5bfe8850837317577 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-07 10:55:16,250 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0d21772dd37bba3b2c4b78b20a3c30e0 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-07 10:55:16,250 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-07 10:55:16,250 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:55:16,250 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:16,250 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. started... 2023-03-07 10:55:16,250 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f26513f1f71767bd16ace3f43fa52372 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-07 10:55:16,679 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230307cfa2cbd6fec74dd4953ec0c6f2ebd3ea to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230307cfa2cbd6fec74dd4953ec0c6f2ebd3ea 2023-03-07 10:55:16,679 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230307aa1c312cc47f4c8caf0cc3707f1027d4 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230307aa1c312cc47f4c8caf0cc3707f1027d4 2023-03-07 10:55:16,679 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303074b0e28029e684108addabacca2b732e9 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303074b0e28029e684108addabacca2b732e9 2023-03-07 10:55:16,689 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp/family1/daa094bed1bb4b02b9b348e0ec4b65ca 2023-03-07 10:55:17,089 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp/family1/ba05f2f176834c0295bd4c13661b2057 2023-03-07 10:55:17,089 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp/family1/9f3590c6a938489a8c6dee641c847d93 2023-03-07 10:55:17,104 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230307fb1faf01485648ce937ba81a5bb30211 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230307fb1faf01485648ce937ba81a5bb30211 2023-03-07 10:55:17,506 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230307d1e88c70d48148d0ae421c3688506084 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230307d1e88c70d48148d0ae421c3688506084 2023-03-07 10:55:17,507 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230307eb7afdedf72d4730b34452209c140600 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230307eb7afdedf72d4730b34452209c140600 2023-03-07 10:55:17,509 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp/family2/b95dd1783dc8473da64b71a3509c87e9 2023-03-07 10:55:17,513 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp/family1/daa094bed1bb4b02b9b348e0ec4b65ca as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/daa094bed1bb4b02b9b348e0ec4b65ca 2023-03-07 10:55:17,517 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/daa094bed1bb4b02b9b348e0ec4b65ca, entries=4, sequenceid=13, filesize=5.4 K 2023-03-07 10:55:17,517 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp/family2/b95dd1783dc8473da64b71a3509c87e9 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/b95dd1783dc8473da64b71a3509c87e9 2023-03-07 10:55:17,520 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/b95dd1783dc8473da64b71a3509c87e9, entries=2, sequenceid=13, filesize=5.1 K 2023-03-07 10:55:17,521 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for f26513f1f71767bd16ace3f43fa52372 in 1271ms, sequenceid=13, compaction requested=true 2023-03-07 10:55:17,521 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f26513f1f71767bd16ace3f43fa52372: 2023-03-07 10:55:17,521 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:17,521 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-07 10:55:17,912 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp/family2/ebb55b1118234afc9d6e873a5355090c 2023-03-07 10:55:17,912 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp/family2/3f49ab0c8c2144ec9a92aa1f89b8c5f4 2023-03-07 10:55:17,916 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp/family1/9f3590c6a938489a8c6dee641c847d93 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/9f3590c6a938489a8c6dee641c847d93 2023-03-07 10:55:17,917 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp/family1/ba05f2f176834c0295bd4c13661b2057 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/ba05f2f176834c0295bd4c13661b2057 2023-03-07 10:55:17,920 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/9f3590c6a938489a8c6dee641c847d93, entries=4, sequenceid=13, filesize=5.4 K 2023-03-07 10:55:17,921 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp/family2/ebb55b1118234afc9d6e873a5355090c as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/ebb55b1118234afc9d6e873a5355090c 2023-03-07 10:55:17,921 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/ba05f2f176834c0295bd4c13661b2057, entries=4, sequenceid=13, filesize=5.4 K 2023-03-07 10:55:17,922 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp/family2/3f49ab0c8c2144ec9a92aa1f89b8c5f4 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/3f49ab0c8c2144ec9a92aa1f89b8c5f4 2023-03-07 10:55:17,925 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/ebb55b1118234afc9d6e873a5355090c, entries=2, sequenceid=13, filesize=5.1 K 2023-03-07 10:55:17,926 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/3f49ab0c8c2144ec9a92aa1f89b8c5f4, entries=2, sequenceid=13, filesize=5.1 K 2023-03-07 10:55:17,926 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for b443f7ebc46146a5bfe8850837317577 in 1677ms, sequenceid=13, compaction requested=true 2023-03-07 10:55:17,926 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 0d21772dd37bba3b2c4b78b20a3c30e0 in 1677ms, sequenceid=13, compaction requested=true 2023-03-07 10:55:17,926 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b443f7ebc46146a5bfe8850837317577: 2023-03-07 10:55:17,926 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0d21772dd37bba3b2c4b78b20a3c30e0: 2023-03-07 10:55:17,926 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:17,926 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:17,926 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-07 10:55:17,927 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-07 10:55:17,927 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-07 10:55:17,927 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:17,927 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-07 10:55:17,927 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-07 10:55:17,928 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:17,928 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:17,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:17,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:17,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:17,928 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:17,929 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:55:17,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:17,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:17,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:17,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:17,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:17,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-07 10:55:17,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@339ab8b6[Count = 0] remaining members to acquire global barrier 2023-03-07 10:55:17,930 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-07 10:55:17,930 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:17,932 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:17,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:17,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:17,933 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-07 10:55:17,933 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-07 10:55:17,933 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:55:17,933 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:17,933 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:55:17,934 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-07 10:55:17,934 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:55:17,934 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:17,934 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-07 10:55:17,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:17,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:17,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:17,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:17,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:17,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:17,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:17,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:17,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:17,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:17,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:55:17,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-07 10:55:17,937 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-07 10:55:17,937 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:55:17,937 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:55:17,937 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-07 10:55:17,937 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:55:17,941 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:17,941 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:17,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:17,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:17,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:17,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:17,942 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:55:17,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:17,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:17,942 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:17,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:55:17,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:55:17,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:17,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:17,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:17,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:17,943 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:17,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:17,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:17,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:17,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:17,946 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:17,946 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:55:17,946 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-07 10:55:17,947 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:55:17,947 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:55:17,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:55:17,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-07 10:55:17,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:55:17,947 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-07 10:55:17,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:55:17,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-07 10:55:17,947 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:17,947 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:17,947 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:17,947 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-07 10:55:17,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:55:17,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:55:17,947 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:17,947 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:55:18,047 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:55:18,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:55:18,049 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:55:18,050 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:55:18,050 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:55:18,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:55:18,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-07 10:55:18,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-07 10:55:18,054 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-07 10:55:18,054 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:55:18,054 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-07 10:55:18,054 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-07 10:55:18,055 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:18,055 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-07 10:55:18,056 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:18,056 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:55:18,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:55:18,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:55:18,056 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:18,056 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:55:18,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-07 10:55:18,057 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:18,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:55:18,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-07 10:55:18,057 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-07 10:55:18,057 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-07 10:55:18,057 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-07 10:55:18,057 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-07 10:55:18,057 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:55:18,057 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-07 10:55:18,057 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:18,057 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. started... 2023-03-07 10:55:18,057 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:18,058 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. started... 2023-03-07 10:55:18,058 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b443f7ebc46146a5bfe8850837317577 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-07 10:55:18,058 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0d21772dd37bba3b2c4b78b20a3c30e0 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-07 10:55:18,060 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-07 10:55:18,060 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:55:18,060 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:18,060 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. started... 2023-03-07 10:55:18,060 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f26513f1f71767bd16ace3f43fa52372 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-07 10:55:18,081 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303072fbc14d87b0b4871bfaf045896222f60 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303072fbc14d87b0b4871bfaf045896222f60 2023-03-07 10:55:18,087 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp/family1/4d783e473cfd49c6a011ff93a846341e 2023-03-07 10:55:18,104 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230307e6a29018b190472b85b8be15faa16732 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230307e6a29018b190472b85b8be15faa16732 2023-03-07 10:55:18,474 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023030707c2b04bd0454afe9f5ffe106c854973 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023030707c2b04bd0454afe9f5ffe106c854973 2023-03-07 10:55:18,477 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230307deb08ef0574b42f2b1f5b31f390ce34e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230307deb08ef0574b42f2b1f5b31f390ce34e 2023-03-07 10:55:18,480 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp/family1/08f3422db7d44740879de03c5cf14cc5 2023-03-07 10:55:18,514 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp/family2/5d65e859364a4b6ab723f7c7a44d2a4b 2023-03-07 10:55:18,517 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp/family1/4d783e473cfd49c6a011ff93a846341e as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/4d783e473cfd49c6a011ff93a846341e 2023-03-07 10:55:18,520 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/4d783e473cfd49c6a011ff93a846341e, entries=4, sequenceid=17, filesize=5.4 K 2023-03-07 10:55:18,521 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp/family2/5d65e859364a4b6ab723f7c7a44d2a4b as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/5d65e859364a4b6ab723f7c7a44d2a4b 2023-03-07 10:55:18,524 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/5d65e859364a4b6ab723f7c7a44d2a4b, entries=2, sequenceid=17, filesize=5.1 K 2023-03-07 10:55:18,525 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 0d21772dd37bba3b2c4b78b20a3c30e0 in 467ms, sequenceid=17, compaction requested=true 2023-03-07 10:55:18,525 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0d21772dd37bba3b2c4b78b20a3c30e0: 2023-03-07 10:55:18,525 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:18,525 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-07 10:55:18,883 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp/family1/8973e2d015544df587456a0ca6168869 2023-03-07 10:55:18,895 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303072358ec422ea148a1ae934755bcdf2f43 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303072358ec422ea148a1ae934755bcdf2f43 2023-03-07 10:55:19,296 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303072e759e67633342029e49a1fc41a803a9 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303072e759e67633342029e49a1fc41a803a9 2023-03-07 10:55:19,300 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp/family2/765bba2f4b744b85b2b6f28fbf7a3f6f 2023-03-07 10:55:19,303 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp/family1/08f3422db7d44740879de03c5cf14cc5 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/08f3422db7d44740879de03c5cf14cc5 2023-03-07 10:55:19,307 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/08f3422db7d44740879de03c5cf14cc5, entries=4, sequenceid=17, filesize=5.4 K 2023-03-07 10:55:19,307 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp/family2/765bba2f4b744b85b2b6f28fbf7a3f6f as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/765bba2f4b744b85b2b6f28fbf7a3f6f 2023-03-07 10:55:19,311 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/765bba2f4b744b85b2b6f28fbf7a3f6f, entries=2, sequenceid=17, filesize=5.1 K 2023-03-07 10:55:19,311 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for b443f7ebc46146a5bfe8850837317577 in 1253ms, sequenceid=17, compaction requested=true 2023-03-07 10:55:19,312 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b443f7ebc46146a5bfe8850837317577: 2023-03-07 10:55:19,312 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:19,312 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-07 10:55:19,701 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp/family2/1655730916ad4fd5b519579e7665c10a 2023-03-07 10:55:19,705 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp/family1/8973e2d015544df587456a0ca6168869 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/8973e2d015544df587456a0ca6168869 2023-03-07 10:55:19,709 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/8973e2d015544df587456a0ca6168869, entries=4, sequenceid=17, filesize=5.4 K 2023-03-07 10:55:19,709 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp/family2/1655730916ad4fd5b519579e7665c10a as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/1655730916ad4fd5b519579e7665c10a 2023-03-07 10:55:19,713 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/1655730916ad4fd5b519579e7665c10a, entries=2, sequenceid=17, filesize=5.1 K 2023-03-07 10:55:19,714 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for f26513f1f71767bd16ace3f43fa52372 in 1654ms, sequenceid=17, compaction requested=true 2023-03-07 10:55:19,714 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f26513f1f71767bd16ace3f43fa52372: 2023-03-07 10:55:19,714 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:19,714 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-07 10:55:19,714 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-07 10:55:19,714 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:19,714 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-07 10:55:19,714 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-07 10:55:19,716 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:19,716 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:19,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:19,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:19,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:19,716 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:19,716 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:55:19,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:19,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:19,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:19,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:19,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:19,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-07 10:55:19,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@52d56815[Count = 0] remaining members to acquire global barrier 2023-03-07 10:55:19,717 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-07 10:55:19,717 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:19,718 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:19,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:19,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:19,718 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-07 10:55:19,718 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-07 10:55:19,718 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:55:19,719 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:19,719 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:55:19,721 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:19,721 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-07 10:55:19,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:19,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:19,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:19,721 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:55:19,721 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-07 10:55:19,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:19,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:19,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:19,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:19,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:19,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:19,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:19,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:55:19,723 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-07 10:55:19,723 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:55:19,723 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:55:19,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-07 10:55:19,723 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-07 10:55:19,723 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:55:19,725 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:19,725 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:19,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:19,725 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:55:19,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:19,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:19,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:19,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:19,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:55:19,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:19,726 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:19,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:55:19,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:19,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:19,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:19,727 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:19,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:19,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:19,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:19,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:19,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:19,729 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:19,729 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:55:19,729 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-07 10:55:19,729 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-07 10:55:19,729 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:19,729 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:55:19,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-07 10:55:19,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:55:19,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:55:19,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-07 10:55:19,729 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:55:19,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:55:19,729 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:19,729 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-07 10:55:19,730 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:19,730 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:55:19,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:55:19,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:55:19,730 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:19,830 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:55:19,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:55:19,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1678186519831 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-07 10:55:19,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1678186519841 (current time:1678186519841). 2023-03-07 10:55:19,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-03-07 10:55:19,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] zookeeper.ReadOnlyZKClient(139): Connect 0x7518ba56 to 127.0.0.1:56055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-07 10:55:19,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a0b05b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-07 10:55:19,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-07 10:55:19,855 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39482, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-07 10:55:19,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7518ba56 to 127.0.0.1:56055 2023-03-07 10:55:19,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-07 10:55:19,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-03-07 10:55:19,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1678186519831 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-07 10:55:19,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-07 10:55:19,869 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-07 10:55:19,870 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1678187119870 2023-03-07 10:55:19,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1678186519831 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-07 10:55:19,870 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1678186519831 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-03-07 10:55:19,871 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-07 10:55:19,872 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-07 10:55:19,873 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 3 msec 2023-03-07 10:55:19,873 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-07 10:55:19,874 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1678187119874 2023-03-07 10:55:19,875 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1678186519831 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-03-07 10:55:19,875 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-03-07 10:55:19,976 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-07 10:55:19,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678186519831 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-07 10:55:19,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1678186519831 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-07 10:55:19,980 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-03-07 10:55:20,180 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-07 10:55:20,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678186519831 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-07 10:55:20,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1678186519831 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-07 10:55:20,181 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-03-07 10:55:20,287 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1678186519831 2023-03-07 10:55:20,287 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1678186519831' 2023-03-07 10:55:20,287 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-03-07 10:55:20,287 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1678186519831' starting 'acquire' 2023-03-07 10:55:20,287 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1678186519831', kicking off acquire phase on members. 2023-03-07 10:55:20,288 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1678186519831 2023-03-07 10:55:20,288 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1678186519831 2023-03-07 10:55:20,289 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-03-07 10:55:20,289 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1678186519831/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:20,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-03-07 10:55:20,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-07 10:55:20,289 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1678186519831/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:20,289 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:55:20,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1678186519831 2023-03-07 10:55:20,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1678186519831 2023-03-07 10:55:20,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-03-07 10:55:20,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1678186519831 2023-03-07 10:55:20,290 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1678186519831 from table testCompactionWithHFileLink type FLUSH 2023-03-07 10:55:20,292 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1678186519831 2023-03-07 10:55:20,293 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1678186519831' with timeout 300000ms 2023-03-07 10:55:20,293 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-03-07 10:55:20,293 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1678186519831' starting 'acquire' stage 2023-03-07 10:55:20,293 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1678186519831' locally acquired 2023-03-07 10:55:20,293 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (snaptb-1678186519831) in zk 2023-03-07 10:55:20,294 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1678186519831 2023-03-07 10:55:20,294 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1678186519831/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:20,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1678186519831/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:20,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:20,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-07 10:55:20,294 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1678186519831 2023-03-07 10:55:20,294 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1678186519831' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:55:20,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:20,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:20,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678186519831 2023-03-07 10:55:20,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:20,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:20,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'snaptb-1678186519831' on coordinator 2023-03-07 10:55:20,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d2de5d2[Count = 0] remaining members to acquire global barrier 2023-03-07 10:55:20,296 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1678186519831' starting 'in-barrier' execution. 2023-03-07 10:55:20,296 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1678186519831 2023-03-07 10:55:20,297 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678186519831 2023-03-07 10:55:20,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1678186519831 2023-03-07 10:55:20,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1678186519831 2023-03-07 10:55:20,297 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1678186519831' received 'reached' from coordinator. 2023-03-07 10:55:20,297 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1678186519831/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:20,297 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:55:20,298 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:20,298 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:20,298 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-03-07 10:55:20,298 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:20,299 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-03-07 10:55:20,299 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. started... 2023-03-07 10:55:20,299 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. started... 2023-03-07 10:55:20,299 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. started... 2023-03-07 10:55:20,299 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for 0d21772dd37bba3b2c4b78b20a3c30e0: 2023-03-07 10:55:20,299 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b443f7ebc46146a5bfe8850837317577: 2023-03-07 10:55:20,299 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for f26513f1f71767bd16ace3f43fa52372: 2023-03-07 10:55:20,300 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372.' region-info for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,300 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0.' region-info for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,300 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577.' region-info for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,305 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-07 10:55:20,305 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-07 10:55:20,305 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-07 10:55:20,478 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-03-07 10:55:20,479 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2fc6f9e3 to 127.0.0.1:56055 2023-03-07 10:55:20,479 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-07 10:55:20,479 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-07 10:55:20,479 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x735186fa to 127.0.0.1:56055 2023-03-07 10:55:20,479 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-07 10:55:20,479 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-07 10:55:20,479 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45ffb306 to 127.0.0.1:56055 2023-03-07 10:55:20,479 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-07 10:55:20,479 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-07 10:55:20,479 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f3795ff to 127.0.0.1:56055 2023-03-07 10:55:20,479 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/385bfcef9cf24048be847a094f25a7ca, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/d8c20ccc995d4822aa0a6447ed64c0ba, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/ba05f2f176834c0295bd4c13661b2057, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/4d783e473cfd49c6a011ff93a846341e] hfiles 2023-03-07 10:55:20,479 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-07 10:55:20,480 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/385bfcef9cf24048be847a094f25a7ca for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,479 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/cb481fb954494136b4a726a0ab103581, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/d21bb01241d24ac2b565a7adbdf4723e, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/9f3590c6a938489a8c6dee641c847d93, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/08f3422db7d44740879de03c5cf14cc5] hfiles 2023-03-07 10:55:20,480 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e3ca89e to 127.0.0.1:56055 2023-03-07 10:55:20,480 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/cb481fb954494136b4a726a0ab103581 for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,480 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/0fea123d4fd84d19af0a53225aafe303, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/b01a2447b583476cb287122573e8faba, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/daa094bed1bb4b02b9b348e0ec4b65ca, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/8973e2d015544df587456a0ca6168869] hfiles 2023-03-07 10:55:20,480 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/0fea123d4fd84d19af0a53225aafe303 for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,480 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-07 10:55:20,481 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-07 10:55:20,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678186519831 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-07 10:55:20,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1678186519831 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-07 10:55:20,483 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-03-07 10:55:20,484 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/d8c20ccc995d4822aa0a6447ed64c0ba for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,484 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/b01a2447b583476cb287122573e8faba for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,484 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/d21bb01241d24ac2b565a7adbdf4723e for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,484 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/daa094bed1bb4b02b9b348e0ec4b65ca for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,484 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/ba05f2f176834c0295bd4c13661b2057 for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,484 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/8973e2d015544df587456a0ca6168869 for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,484 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/4d783e473cfd49c6a011ff93a846341e for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,484 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/9f3590c6a938489a8c6dee641c847d93 for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,484 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/08f3422db7d44740879de03c5cf14cc5 for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,484 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/4a61a5e4bafc4924b54fb3680d1bf155, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/d4c9be19609b4018b7e188ac1153e94f, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/3f49ab0c8c2144ec9a92aa1f89b8c5f4, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/5d65e859364a4b6ab723f7c7a44d2a4b] hfiles 2023-03-07 10:55:20,484 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/155cce75e6a1420499a693f041db2a8a, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/ddd7d6d0122b4ae4aa75ab21a617e772, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/ebb55b1118234afc9d6e873a5355090c, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/765bba2f4b744b85b2b6f28fbf7a3f6f] hfiles 2023-03-07 10:55:20,485 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/155cce75e6a1420499a693f041db2a8a for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,484 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/4a61a5e4bafc4924b54fb3680d1bf155 for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,485 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/d4c9be19609b4018b7e188ac1153e94f for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,484 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/f70d3690b0f447b49db6d7eb03105784, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/fc1ba96d8b7d4bc88a13a242f8274347, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/b95dd1783dc8473da64b71a3509c87e9, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/1655730916ad4fd5b519579e7665c10a] hfiles 2023-03-07 10:55:20,485 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/3f49ab0c8c2144ec9a92aa1f89b8c5f4 for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,485 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/ddd7d6d0122b4ae4aa75ab21a617e772 for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,485 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/5d65e859364a4b6ab723f7c7a44d2a4b for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,485 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/f70d3690b0f447b49db6d7eb03105784 for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,485 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/ebb55b1118234afc9d6e873a5355090c for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,485 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/765bba2f4b744b85b2b6f28fbf7a3f6f for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,485 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/fc1ba96d8b7d4bc88a13a242f8274347 for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,485 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/b95dd1783dc8473da64b71a3509c87e9 for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,485 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/1655730916ad4fd5b519579e7665c10a for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,506 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. completed. 2023-03-07 10:55:20,506 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:20,506 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-03-07 10:55:20,508 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. completed. 2023-03-07 10:55:20,508 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:20,508 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-03-07 10:55:20,907 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. completed. 2023-03-07 10:55:20,907 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:20,907 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-03-07 10:55:20,907 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-03-07 10:55:20,907 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:20,907 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1678186519831' locally completed 2023-03-07 10:55:20,907 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1678186519831' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:55:20,909 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1678186519831' has notified controller of completion 2023-03-07 10:55:20,909 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:55:20,909 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678186519831/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:20,909 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1678186519831' completed. 2023-03-07 10:55:20,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1678186519831/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:20,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:20,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-07 10:55:20,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:20,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:20,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678186519831 2023-03-07 10:55:20,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:20,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:20,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678186519831 2023-03-07 10:55:20,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:20,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1678186519831' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:55:20,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'snaptb-1678186519831', counting down latch. Waiting for 0 more 2023-03-07 10:55:20,911 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1678186519831' execution completed 2023-03-07 10:55:20,911 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:55:20,911 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:55:20,911 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1678186519831 2023-03-07 10:55:20,911 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1678186519831including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-03-07 10:55:20,913 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1678186519831 2023-03-07 10:55:20,913 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1678186519831 2023-03-07 10:55:20,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1678186519831 2023-03-07 10:55:20,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1678186519831 2023-03-07 10:55:20,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:20,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-07 10:55:20,913 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-03-07 10:55:20,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1678186519831 2023-03-07 10:55:20,914 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1678186519831/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:20,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:20,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-03-07 10:55:20,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-07 10:55:20,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1678186519831 2023-03-07 10:55:20,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678186519831 2023-03-07 10:55:20,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:20,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678186519831 2023-03-07 10:55:20,915 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1678186519831/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:20,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:20,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:20,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678186519831 2023-03-07 10:55:20,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:20,918 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-03-07 10:55:20,918 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1678186519831/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:20,918 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-03-07 10:55:20,918 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1678186519831 2023-03-07 10:55:20,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-03-07 10:55:20,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-07 10:55:20,918 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1678186519831 2023-03-07 10:55:20,918 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:55:20,918 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1678186519831 2023-03-07 10:55:20,918 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-03-07 10:55:20,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-03-07 10:55:20,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-07 10:55:20,918 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678186519831/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:20,918 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1678186519831 2023-03-07 10:55:20,918 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678186519831 2023-03-07 10:55:20,918 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-03-07 10:55:20,919 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678186519831 2023-03-07 10:55:20,919 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1678186519831 2023-03-07 10:55:20,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023030707c2b04bd0454afe9f5ffe106c854973, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230307113ba20ec7aa40c1a7dedda473e727ef, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230307aa1c312cc47f4c8caf0cc3707f1027d4, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230307faa4a20384264bcab422aee73cf4231b, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303070e1333264a4544428affb3bb698cf9ab, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230307bbd158cb8f784e08b5c8039b606cfbf2, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230307cfa2cbd6fec74dd4953ec0c6f2ebd3ea, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230307deb08ef0574b42f2b1f5b31f390ce34e, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303072fbc14d87b0b4871bfaf045896222f60, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303073736dae9f7044ad8aebf6ed5bd19ceb6, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303074776994284e2411e9710ec77eb9e8c9c, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303074b0e28029e684108addabacca2b732e9] mob files 2023-03-07 10:55:20,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023030707c2b04bd0454afe9f5ffe106c854973 2023-03-07 10:55:20,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230307113ba20ec7aa40c1a7dedda473e727ef 2023-03-07 10:55:20,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230307aa1c312cc47f4c8caf0cc3707f1027d4 2023-03-07 10:55:20,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230307faa4a20384264bcab422aee73cf4231b 2023-03-07 10:55:20,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303070e1333264a4544428affb3bb698cf9ab 2023-03-07 10:55:20,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230307bbd158cb8f784e08b5c8039b606cfbf2 2023-03-07 10:55:20,922 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230307cfa2cbd6fec74dd4953ec0c6f2ebd3ea 2023-03-07 10:55:20,922 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230307deb08ef0574b42f2b1f5b31f390ce34e 2023-03-07 10:55:20,922 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303072fbc14d87b0b4871bfaf045896222f60 2023-03-07 10:55:20,922 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303073736dae9f7044ad8aebf6ed5bd19ceb6 2023-03-07 10:55:20,922 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303074776994284e2411e9710ec77eb9e8c9c 2023-03-07 10:55:20,922 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303074b0e28029e684108addabacca2b732e9 2023-03-07 10:55:20,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303071003135a9b3c4d298a17bc34eada6dd9, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303072358ec422ea148a1ae934755bcdf2f43, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230307740266b3b3b24e0f89807c29dff13c8f, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230307d1e88c70d48148d0ae421c3688506084, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023030729d55aea989b444285ab12d6b89d38eb, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303072e759e67633342029e49a1fc41a803a9, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230307c0e1932178864f588591f3e3d65647e1, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230307fb1faf01485648ce937ba81a5bb30211, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303079a884a6968b9404aae09675031ad3bc5, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230307cf8659d6b6dd45728cb137d0b2624478, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230307e6a29018b190472b85b8be15faa16732, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230307eb7afdedf72d4730b34452209c140600] mob files 2023-03-07 10:55:20,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303071003135a9b3c4d298a17bc34eada6dd9 2023-03-07 10:55:20,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303072358ec422ea148a1ae934755bcdf2f43 2023-03-07 10:55:20,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230307740266b3b3b24e0f89807c29dff13c8f 2023-03-07 10:55:20,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230307d1e88c70d48148d0ae421c3688506084 2023-03-07 10:55:20,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023030729d55aea989b444285ab12d6b89d38eb 2023-03-07 10:55:20,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303072e759e67633342029e49a1fc41a803a9 2023-03-07 10:55:20,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230307c0e1932178864f588591f3e3d65647e1 2023-03-07 10:55:20,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230307fb1faf01485648ce937ba81a5bb30211 2023-03-07 10:55:20,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303079a884a6968b9404aae09675031ad3bc5 2023-03-07 10:55:20,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230307cf8659d6b6dd45728cb137d0b2624478 2023-03-07 10:55:20,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230307e6a29018b190472b85b8be15faa16732 2023-03-07 10:55:20,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230307eb7afdedf72d4730b34452209c140600 2023-03-07 10:55:20,983 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-07 10:55:20,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678186519831 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-07 10:55:20,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1678186519831 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-07 10:55:20,984 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-03-07 10:55:21,329 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1678186519831 2023-03-07 10:55:21,332 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.hbase-snapshot/.tmp/snaptb-1678186519831 2023-03-07 10:55:21,774 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.hbase-snapshot/.tmp/snaptb-1678186519831 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.hbase-snapshot/snaptb-1678186519831 2023-03-07 10:55:21,984 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-07 10:55:21,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678186519831 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-07 10:55:21,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1678186519831 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-07 10:55:21,985 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2428): (#6) Sleeping: 2000ms while waiting for snapshot completion. 2023-03-07 10:55:22,589 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1678186519831 of table testCompactionWithHFileLink completed 2023-03-07 10:55:22,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.hbase-snapshot/.tmp/snaptb-1678186519831 2023-03-07 10:55:22,590 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.hbase-snapshot/.tmp/snaptb-1678186519831 2023-03-07 10:55:22,590 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1678186519831 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1678186519870Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1678186521329 (+1459 ms)Consolidate snapshot: snaptb-1678186519831 at 1678186521329Loading Region manifests for snaptb-1678186519831 at 1678186521329Writing data manifest for snaptb-1678186519831 at 1678186521339 (+10 ms)Verifying snapshot: snaptb-1678186519831 at 1678186521747 (+408 ms)Snapshot snaptb-1678186519831 of table testCompactionWithHFileLink completed at 1678186522589 (+842 ms) 2023-03-07 10:55:22,591 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-07 10:55:22,593 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 2.7190 sec 2023-03-07 10:55:23,986 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-07 10:55:23,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678186519831 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-07 10:55:23,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1678186519831 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-03-07 10:55:24,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:55:24,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-07 10:55:24,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-07 10:55:24,017 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-07 10:55:24,018 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:55:24,018 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-07 10:55:24,018 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-07 10:55:24,018 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:24,018 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-07 10:55:24,019 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:24,019 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:55:24,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:55:24,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:55:24,020 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:24,020 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:55:24,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-07 10:55:24,020 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:24,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:55:24,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-07 10:55:24,020 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-07 10:55:24,021 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-07 10:55:24,021 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-07 10:55:24,021 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:55:24,021 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-07 10:55:24,021 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:24,021 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. started... 2023-03-07 10:55:24,021 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-07 10:55:24,021 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:24,021 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:24,021 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b443f7ebc46146a5bfe8850837317577 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-07 10:55:24,021 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. started... 2023-03-07 10:55:24,021 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:55:24,021 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. started... 2023-03-07 10:55:24,021 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f26513f1f71767bd16ace3f43fa52372 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-07 10:55:24,021 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0d21772dd37bba3b2c4b78b20a3c30e0 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-07 10:55:24,437 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp/family1/5a868b5fa76c415095bb630fc72b8f73 2023-03-07 10:55:24,441 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a868b5fa76c415095bb630fc72b8f73 2023-03-07 10:55:24,835 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp/family1/cf41cfbe186e42139dcf7cdf3a37a487 2023-03-07 10:55:24,835 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp/family1/a49d4da19a7e4154b4b200bbcdb43c54 2023-03-07 10:55:24,839 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cf41cfbe186e42139dcf7cdf3a37a487 2023-03-07 10:55:24,839 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a49d4da19a7e4154b4b200bbcdb43c54 2023-03-07 10:55:25,254 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp/family2/59647f51142849668ae70d77f3c5a53d 2023-03-07 10:55:25,257 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 59647f51142849668ae70d77f3c5a53d 2023-03-07 10:55:25,257 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp/family1/5a868b5fa76c415095bb630fc72b8f73 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/5a868b5fa76c415095bb630fc72b8f73 2023-03-07 10:55:25,261 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a868b5fa76c415095bb630fc72b8f73 2023-03-07 10:55:25,261 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/5a868b5fa76c415095bb630fc72b8f73, entries=3, sequenceid=24, filesize=5.0 K 2023-03-07 10:55:25,262 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp/family2/59647f51142849668ae70d77f3c5a53d as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/59647f51142849668ae70d77f3c5a53d 2023-03-07 10:55:25,265 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 59647f51142849668ae70d77f3c5a53d 2023-03-07 10:55:25,266 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/59647f51142849668ae70d77f3c5a53d, entries=1, sequenceid=24, filesize=5.0 K 2023-03-07 10:55:25,266 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 0d21772dd37bba3b2c4b78b20a3c30e0 in 1245ms, sequenceid=24, compaction requested=true 2023-03-07 10:55:25,266 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0d21772dd37bba3b2c4b78b20a3c30e0: 2023-03-07 10:55:25,266 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:25,267 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-07 10:55:25,652 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp/family2/1fdb744c8abd4e03ae29ac6134b3a78a 2023-03-07 10:55:25,652 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp/family2/0ca90047dc8d4fea92fa66ca7f37945c 2023-03-07 10:55:25,656 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0ca90047dc8d4fea92fa66ca7f37945c 2023-03-07 10:55:25,656 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1fdb744c8abd4e03ae29ac6134b3a78a 2023-03-07 10:55:25,657 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp/family1/cf41cfbe186e42139dcf7cdf3a37a487 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/cf41cfbe186e42139dcf7cdf3a37a487 2023-03-07 10:55:25,657 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp/family1/a49d4da19a7e4154b4b200bbcdb43c54 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/a49d4da19a7e4154b4b200bbcdb43c54 2023-03-07 10:55:25,660 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cf41cfbe186e42139dcf7cdf3a37a487 2023-03-07 10:55:25,660 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a49d4da19a7e4154b4b200bbcdb43c54 2023-03-07 10:55:25,661 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/cf41cfbe186e42139dcf7cdf3a37a487, entries=3, sequenceid=24, filesize=5.0 K 2023-03-07 10:55:25,661 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/a49d4da19a7e4154b4b200bbcdb43c54, entries=3, sequenceid=24, filesize=5.0 K 2023-03-07 10:55:25,661 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp/family2/1fdb744c8abd4e03ae29ac6134b3a78a as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/1fdb744c8abd4e03ae29ac6134b3a78a 2023-03-07 10:55:25,661 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp/family2/0ca90047dc8d4fea92fa66ca7f37945c as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/0ca90047dc8d4fea92fa66ca7f37945c 2023-03-07 10:55:25,665 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1fdb744c8abd4e03ae29ac6134b3a78a 2023-03-07 10:55:25,665 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0ca90047dc8d4fea92fa66ca7f37945c 2023-03-07 10:55:25,665 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/1fdb744c8abd4e03ae29ac6134b3a78a, entries=1, sequenceid=24, filesize=5.0 K 2023-03-07 10:55:25,665 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/0ca90047dc8d4fea92fa66ca7f37945c, entries=1, sequenceid=24, filesize=5.0 K 2023-03-07 10:55:25,666 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for b443f7ebc46146a5bfe8850837317577 in 1645ms, sequenceid=24, compaction requested=true 2023-03-07 10:55:25,666 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for f26513f1f71767bd16ace3f43fa52372 in 1645ms, sequenceid=24, compaction requested=true 2023-03-07 10:55:25,666 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b443f7ebc46146a5bfe8850837317577: 2023-03-07 10:55:25,666 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f26513f1f71767bd16ace3f43fa52372: 2023-03-07 10:55:25,666 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:25,666 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:25,666 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-07 10:55:25,666 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-07 10:55:25,666 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-07 10:55:25,666 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:25,666 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-07 10:55:25,666 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-07 10:55:25,668 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:25,668 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:25,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:25,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:25,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:25,668 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:25,668 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:55:25,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:25,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:25,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:25,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:25,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:25,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-07 10:55:25,669 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-07 10:55:25,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6616cf71[Count = 0] remaining members to acquire global barrier 2023-03-07 10:55:25,669 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:25,677 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:25,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:25,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:25,677 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:25,677 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:55:25,677 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-07 10:55:25,677 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-07 10:55:25,677 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:55:25,679 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-07 10:55:25,679 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:25,679 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:55:25,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:25,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:25,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:25,679 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-07 10:55:25,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:25,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:25,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:25,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:25,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:25,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:25,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:25,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:55:25,681 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-07 10:55:25,681 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-07 10:55:25,681 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:55:25,681 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:55:25,681 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-07 10:55:25,681 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:55:25,682 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:25,682 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:25,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:25,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:25,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:25,682 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:55:25,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:25,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:25,683 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:25,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:55:25,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:55:25,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:25,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:25,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:25,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:25,684 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:25,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:25,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:25,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:25,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-07 10:55:25,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:25,686 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:25,686 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-07 10:55:25,686 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-07 10:55:25,686 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:25,686 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:25,686 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-07 10:55:25,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-07 10:55:25,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:55:25,686 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:55:25,686 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-07 10:55:25,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:55:25,686 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:55:25,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:55:25,687 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-07 10:55:25,686 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:55:25,687 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:55:25,687 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-07 10:55:25,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:55:25,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:55:25,787 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:55:25,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:55:25,789 DEBUG [Listener at localhost/42383] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-07 10:55:25,789 DEBUG [Listener at localhost/42383] regionserver.HStore(1912): b443f7ebc46146a5bfe8850837317577/family1 is initiating major compaction (all files) 2023-03-07 10:55:25,789 INFO [Listener at localhost/42383] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-07 10:55:25,789 INFO [Listener at localhost/42383] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-07 10:55:25,789 INFO [Listener at localhost/42383] regionserver.HRegion(2259): Starting compaction of b443f7ebc46146a5bfe8850837317577/family1 in testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:25,789 INFO [Listener at localhost/42383] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/cb481fb954494136b4a726a0ab103581, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/d21bb01241d24ac2b565a7adbdf4723e, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/9f3590c6a938489a8c6dee641c847d93, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/08f3422db7d44740879de03c5cf14cc5, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/a49d4da19a7e4154b4b200bbcdb43c54] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp, totalSize=26.7 K 2023-03-07 10:55:25,790 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting cb481fb954494136b4a726a0ab103581, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678186512664 2023-03-07 10:55:25,790 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting d21bb01241d24ac2b565a7adbdf4723e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678186514447 2023-03-07 10:55:25,791 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 9f3590c6a938489a8c6dee641c847d93, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678186516241 2023-03-07 10:55:25,791 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 08f3422db7d44740879de03c5cf14cc5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678186518050 2023-03-07 10:55:25,791 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting a49d4da19a7e4154b4b200bbcdb43c54, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-07 10:55:25,803 INFO [Listener at localhost/42383] throttle.PressureAwareThroughputController(145): b443f7ebc46146a5bfe8850837317577#family1#compaction#108 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:55:26,211 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230307ad7b708ff6ba4c2c8647133c8be2e1ca_del 2023-03-07 10:55:26,211 INFO [Listener at localhost/42383] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230307ad7b708ff6ba4c2c8647133c8be2e1ca_del to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230307ad7b708ff6ba4c2c8647133c8be2e1ca_del 2023-03-07 10:55:27,025 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for be5a95b50dc643e89fadd00ff3828720 2023-03-07 10:55:27,026 DEBUG [Listener at localhost/42383] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp/family1/be5a95b50dc643e89fadd00ff3828720 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/be5a95b50dc643e89fadd00ff3828720 2023-03-07 10:55:27,029 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for be5a95b50dc643e89fadd00ff3828720 2023-03-07 10:55:27,030 INFO [Listener at localhost/42383] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b443f7ebc46146a5bfe8850837317577/family1 of b443f7ebc46146a5bfe8850837317577 into be5a95b50dc643e89fadd00ff3828720(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-07 10:55:27,030 DEBUG [Listener at localhost/42383] regionserver.HRegion(2289): Compaction status journal for b443f7ebc46146a5bfe8850837317577: 2023-03-07 10:55:27,030 DEBUG [Listener at localhost/42383] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-07 10:55:27,030 DEBUG [Listener at localhost/42383] regionserver.HStore(1912): b443f7ebc46146a5bfe8850837317577/family2 is initiating major compaction (all files) 2023-03-07 10:55:27,030 INFO [Listener at localhost/42383] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-07 10:55:27,030 INFO [Listener at localhost/42383] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-07 10:55:27,030 INFO [Listener at localhost/42383] regionserver.HRegion(2259): Starting compaction of b443f7ebc46146a5bfe8850837317577/family2 in testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:27,031 INFO [Listener at localhost/42383] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/155cce75e6a1420499a693f041db2a8a, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/ddd7d6d0122b4ae4aa75ab21a617e772, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/ebb55b1118234afc9d6e873a5355090c, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/765bba2f4b744b85b2b6f28fbf7a3f6f, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/1fdb744c8abd4e03ae29ac6134b3a78a] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp, totalSize=25.4 K 2023-03-07 10:55:27,031 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 155cce75e6a1420499a693f041db2a8a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678186512664 2023-03-07 10:55:27,031 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting ddd7d6d0122b4ae4aa75ab21a617e772, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678186514447 2023-03-07 10:55:27,032 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting ebb55b1118234afc9d6e873a5355090c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678186516241 2023-03-07 10:55:27,032 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 765bba2f4b744b85b2b6f28fbf7a3f6f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678186518050 2023-03-07 10:55:27,032 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 1fdb744c8abd4e03ae29ac6134b3a78a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-07 10:55:27,043 INFO [Listener at localhost/42383] throttle.PressureAwareThroughputController(145): b443f7ebc46146a5bfe8850837317577#family2#compaction#109 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:55:27,080 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/cb481fb954494136b4a726a0ab103581, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/d21bb01241d24ac2b565a7adbdf4723e, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/9f3590c6a938489a8c6dee641c847d93, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/08f3422db7d44740879de03c5cf14cc5, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/a49d4da19a7e4154b4b200bbcdb43c54] to archive 2023-03-07 10:55:27,081 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:27,083 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/cb481fb954494136b4a726a0ab103581 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/cb481fb954494136b4a726a0ab103581 2023-03-07 10:55:27,084 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/d21bb01241d24ac2b565a7adbdf4723e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/d21bb01241d24ac2b565a7adbdf4723e 2023-03-07 10:55:27,085 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/9f3590c6a938489a8c6dee641c847d93 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/9f3590c6a938489a8c6dee641c847d93 2023-03-07 10:55:27,086 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/08f3422db7d44740879de03c5cf14cc5 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/08f3422db7d44740879de03c5cf14cc5 2023-03-07 10:55:27,088 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/a49d4da19a7e4154b4b200bbcdb43c54 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/a49d4da19a7e4154b4b200bbcdb43c54 2023-03-07 10:55:27,452 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230307dcf7c5d98d554121966f2ba61acdd195_del 2023-03-07 10:55:27,452 INFO [Listener at localhost/42383] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230307dcf7c5d98d554121966f2ba61acdd195_del to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230307dcf7c5d98d554121966f2ba61acdd195_del 2023-03-07 10:55:28,264 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fa9f29c831de4822a76fdce95825faeb 2023-03-07 10:55:28,265 DEBUG [Listener at localhost/42383] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp/family2/fa9f29c831de4822a76fdce95825faeb as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/fa9f29c831de4822a76fdce95825faeb 2023-03-07 10:55:28,268 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fa9f29c831de4822a76fdce95825faeb 2023-03-07 10:55:28,269 INFO [Listener at localhost/42383] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b443f7ebc46146a5bfe8850837317577/family2 of b443f7ebc46146a5bfe8850837317577 into fa9f29c831de4822a76fdce95825faeb(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-07 10:55:28,269 DEBUG [Listener at localhost/42383] regionserver.HRegion(2289): Compaction status journal for b443f7ebc46146a5bfe8850837317577: 2023-03-07 10:55:28,269 DEBUG [Listener at localhost/42383] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-07 10:55:28,269 DEBUG [Listener at localhost/42383] regionserver.HStore(1912): 0d21772dd37bba3b2c4b78b20a3c30e0/family1 is initiating major compaction (all files) 2023-03-07 10:55:28,270 INFO [Listener at localhost/42383] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-07 10:55:28,270 INFO [Listener at localhost/42383] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-07 10:55:28,270 INFO [Listener at localhost/42383] regionserver.HRegion(2259): Starting compaction of 0d21772dd37bba3b2c4b78b20a3c30e0/family1 in testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:28,270 INFO [Listener at localhost/42383] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/385bfcef9cf24048be847a094f25a7ca, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/d8c20ccc995d4822aa0a6447ed64c0ba, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/ba05f2f176834c0295bd4c13661b2057, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/4d783e473cfd49c6a011ff93a846341e, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/5a868b5fa76c415095bb630fc72b8f73] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp, totalSize=26.7 K 2023-03-07 10:55:28,270 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 385bfcef9cf24048be847a094f25a7ca, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678186512662 2023-03-07 10:55:28,270 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting d8c20ccc995d4822aa0a6447ed64c0ba, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678186514447 2023-03-07 10:55:28,271 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting ba05f2f176834c0295bd4c13661b2057, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678186516241 2023-03-07 10:55:28,271 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 4d783e473cfd49c6a011ff93a846341e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678186518049 2023-03-07 10:55:28,271 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 5a868b5fa76c415095bb630fc72b8f73, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-07 10:55:28,279 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/155cce75e6a1420499a693f041db2a8a, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/ddd7d6d0122b4ae4aa75ab21a617e772, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/ebb55b1118234afc9d6e873a5355090c, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/765bba2f4b744b85b2b6f28fbf7a3f6f, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/1fdb744c8abd4e03ae29ac6134b3a78a] to archive 2023-03-07 10:55:28,280 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:28,281 INFO [Listener at localhost/42383] throttle.PressureAwareThroughputController(145): 0d21772dd37bba3b2c4b78b20a3c30e0#family1#compaction#110 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:55:28,281 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/155cce75e6a1420499a693f041db2a8a to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/155cce75e6a1420499a693f041db2a8a 2023-03-07 10:55:28,283 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/ddd7d6d0122b4ae4aa75ab21a617e772 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/ddd7d6d0122b4ae4aa75ab21a617e772 2023-03-07 10:55:28,284 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/ebb55b1118234afc9d6e873a5355090c to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/ebb55b1118234afc9d6e873a5355090c 2023-03-07 10:55:28,285 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/765bba2f4b744b85b2b6f28fbf7a3f6f to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/765bba2f4b744b85b2b6f28fbf7a3f6f 2023-03-07 10:55:28,287 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/1fdb744c8abd4e03ae29ac6134b3a78a to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/1fdb744c8abd4e03ae29ac6134b3a78a 2023-03-07 10:55:28,697 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230307e4f338493d0242498b06440ad85acc78_del 2023-03-07 10:55:28,698 INFO [Listener at localhost/42383] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230307e4f338493d0242498b06440ad85acc78_del to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230307e4f338493d0242498b06440ad85acc78_del 2023-03-07 10:55:29,511 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 05b30b6132db41b3a340939ddb08ba80 2023-03-07 10:55:29,512 DEBUG [Listener at localhost/42383] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp/family1/05b30b6132db41b3a340939ddb08ba80 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/05b30b6132db41b3a340939ddb08ba80 2023-03-07 10:55:29,515 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 05b30b6132db41b3a340939ddb08ba80 2023-03-07 10:55:29,516 INFO [Listener at localhost/42383] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0d21772dd37bba3b2c4b78b20a3c30e0/family1 of 0d21772dd37bba3b2c4b78b20a3c30e0 into 05b30b6132db41b3a340939ddb08ba80(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-07 10:55:29,516 DEBUG [Listener at localhost/42383] regionserver.HRegion(2289): Compaction status journal for 0d21772dd37bba3b2c4b78b20a3c30e0: 2023-03-07 10:55:29,516 DEBUG [Listener at localhost/42383] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-07 10:55:29,516 DEBUG [Listener at localhost/42383] regionserver.HStore(1912): 0d21772dd37bba3b2c4b78b20a3c30e0/family2 is initiating major compaction (all files) 2023-03-07 10:55:29,517 INFO [Listener at localhost/42383] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-07 10:55:29,517 INFO [Listener at localhost/42383] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-07 10:55:29,517 INFO [Listener at localhost/42383] regionserver.HRegion(2259): Starting compaction of 0d21772dd37bba3b2c4b78b20a3c30e0/family2 in testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:29,517 INFO [Listener at localhost/42383] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/4a61a5e4bafc4924b54fb3680d1bf155, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/d4c9be19609b4018b7e188ac1153e94f, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/3f49ab0c8c2144ec9a92aa1f89b8c5f4, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/5d65e859364a4b6ab723f7c7a44d2a4b, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/59647f51142849668ae70d77f3c5a53d] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp, totalSize=25.4 K 2023-03-07 10:55:29,517 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 4a61a5e4bafc4924b54fb3680d1bf155, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678186512662 2023-03-07 10:55:29,517 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting d4c9be19609b4018b7e188ac1153e94f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678186514447 2023-03-07 10:55:29,518 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 3f49ab0c8c2144ec9a92aa1f89b8c5f4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678186516241 2023-03-07 10:55:29,518 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 5d65e859364a4b6ab723f7c7a44d2a4b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678186518049 2023-03-07 10:55:29,518 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 59647f51142849668ae70d77f3c5a53d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-07 10:55:29,529 INFO [Listener at localhost/42383] throttle.PressureAwareThroughputController(145): 0d21772dd37bba3b2c4b78b20a3c30e0#family2#compaction#111 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:55:29,579 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/385bfcef9cf24048be847a094f25a7ca, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/d8c20ccc995d4822aa0a6447ed64c0ba, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/ba05f2f176834c0295bd4c13661b2057, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/4d783e473cfd49c6a011ff93a846341e, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/5a868b5fa76c415095bb630fc72b8f73] to archive 2023-03-07 10:55:29,580 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:29,581 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/385bfcef9cf24048be847a094f25a7ca to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/385bfcef9cf24048be847a094f25a7ca 2023-03-07 10:55:29,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/d8c20ccc995d4822aa0a6447ed64c0ba to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/d8c20ccc995d4822aa0a6447ed64c0ba 2023-03-07 10:55:29,583 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/ba05f2f176834c0295bd4c13661b2057 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/ba05f2f176834c0295bd4c13661b2057 2023-03-07 10:55:29,584 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/4d783e473cfd49c6a011ff93a846341e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/4d783e473cfd49c6a011ff93a846341e 2023-03-07 10:55:29,585 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/5a868b5fa76c415095bb630fc72b8f73 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/5a868b5fa76c415095bb630fc72b8f73 2023-03-07 10:55:29,942 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023030769dad6365f5c4a4abbf063fdd95b2b92_del 2023-03-07 10:55:29,943 INFO [Listener at localhost/42383] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023030769dad6365f5c4a4abbf063fdd95b2b92_del to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023030769dad6365f5c4a4abbf063fdd95b2b92_del 2023-03-07 10:55:30,757 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7d4f05bc6c7d416eb4042dda5f218837 2023-03-07 10:55:30,757 DEBUG [Listener at localhost/42383] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp/family2/7d4f05bc6c7d416eb4042dda5f218837 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/7d4f05bc6c7d416eb4042dda5f218837 2023-03-07 10:55:30,760 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7d4f05bc6c7d416eb4042dda5f218837 2023-03-07 10:55:30,761 INFO [Listener at localhost/42383] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0d21772dd37bba3b2c4b78b20a3c30e0/family2 of 0d21772dd37bba3b2c4b78b20a3c30e0 into 7d4f05bc6c7d416eb4042dda5f218837(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-07 10:55:30,762 DEBUG [Listener at localhost/42383] regionserver.HRegion(2289): Compaction status journal for 0d21772dd37bba3b2c4b78b20a3c30e0: 2023-03-07 10:55:30,762 DEBUG [Listener at localhost/42383] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-07 10:55:30,762 DEBUG [Listener at localhost/42383] regionserver.HStore(1912): f26513f1f71767bd16ace3f43fa52372/family1 is initiating major compaction (all files) 2023-03-07 10:55:30,762 INFO [Listener at localhost/42383] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-07 10:55:30,762 INFO [Listener at localhost/42383] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-07 10:55:30,762 INFO [Listener at localhost/42383] regionserver.HRegion(2259): Starting compaction of f26513f1f71767bd16ace3f43fa52372/family1 in testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:30,763 INFO [Listener at localhost/42383] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/0fea123d4fd84d19af0a53225aafe303, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/b01a2447b583476cb287122573e8faba, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/daa094bed1bb4b02b9b348e0ec4b65ca, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/8973e2d015544df587456a0ca6168869, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/cf41cfbe186e42139dcf7cdf3a37a487] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp, totalSize=26.7 K 2023-03-07 10:55:30,763 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 0fea123d4fd84d19af0a53225aafe303, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678186512665 2023-03-07 10:55:30,764 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting b01a2447b583476cb287122573e8faba, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678186514447 2023-03-07 10:55:30,764 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting daa094bed1bb4b02b9b348e0ec4b65ca, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678186516242 2023-03-07 10:55:30,764 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 8973e2d015544df587456a0ca6168869, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678186518050 2023-03-07 10:55:30,765 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting cf41cfbe186e42139dcf7cdf3a37a487, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-07 10:55:30,777 INFO [Listener at localhost/42383] throttle.PressureAwareThroughputController(145): f26513f1f71767bd16ace3f43fa52372#family1#compaction#112 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:55:30,779 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/4a61a5e4bafc4924b54fb3680d1bf155, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/d4c9be19609b4018b7e188ac1153e94f, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/3f49ab0c8c2144ec9a92aa1f89b8c5f4, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/5d65e859364a4b6ab723f7c7a44d2a4b, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/59647f51142849668ae70d77f3c5a53d] to archive 2023-03-07 10:55:30,780 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:30,781 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/4a61a5e4bafc4924b54fb3680d1bf155 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/4a61a5e4bafc4924b54fb3680d1bf155 2023-03-07 10:55:30,783 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/d4c9be19609b4018b7e188ac1153e94f to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/d4c9be19609b4018b7e188ac1153e94f 2023-03-07 10:55:30,784 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/3f49ab0c8c2144ec9a92aa1f89b8c5f4 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/3f49ab0c8c2144ec9a92aa1f89b8c5f4 2023-03-07 10:55:30,785 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/5d65e859364a4b6ab723f7c7a44d2a4b to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/5d65e859364a4b6ab723f7c7a44d2a4b 2023-03-07 10:55:30,785 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303077d1bd83226e94d71b8b99ce68400418a_del 2023-03-07 10:55:30,785 INFO [Listener at localhost/42383] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303077d1bd83226e94d71b8b99ce68400418a_del to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303077d1bd83226e94d71b8b99ce68400418a_del 2023-03-07 10:55:30,786 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/59647f51142849668ae70d77f3c5a53d to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/59647f51142849668ae70d77f3c5a53d 2023-03-07 10:55:31,600 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9d49b245dccc47889db6f5ff68a25de4 2023-03-07 10:55:31,601 DEBUG [Listener at localhost/42383] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp/family1/9d49b245dccc47889db6f5ff68a25de4 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/9d49b245dccc47889db6f5ff68a25de4 2023-03-07 10:55:31,605 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9d49b245dccc47889db6f5ff68a25de4 2023-03-07 10:55:31,606 INFO [Listener at localhost/42383] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f26513f1f71767bd16ace3f43fa52372/family1 of f26513f1f71767bd16ace3f43fa52372 into 9d49b245dccc47889db6f5ff68a25de4(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-07 10:55:31,606 DEBUG [Listener at localhost/42383] regionserver.HRegion(2289): Compaction status journal for f26513f1f71767bd16ace3f43fa52372: 2023-03-07 10:55:31,606 DEBUG [Listener at localhost/42383] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-07 10:55:31,606 DEBUG [Listener at localhost/42383] regionserver.HStore(1912): f26513f1f71767bd16ace3f43fa52372/family2 is initiating major compaction (all files) 2023-03-07 10:55:31,606 INFO [Listener at localhost/42383] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-07 10:55:31,606 INFO [Listener at localhost/42383] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-07 10:55:31,607 INFO [Listener at localhost/42383] regionserver.HRegion(2259): Starting compaction of f26513f1f71767bd16ace3f43fa52372/family2 in testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:31,607 INFO [Listener at localhost/42383] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/f70d3690b0f447b49db6d7eb03105784, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/fc1ba96d8b7d4bc88a13a242f8274347, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/b95dd1783dc8473da64b71a3509c87e9, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/1655730916ad4fd5b519579e7665c10a, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/0ca90047dc8d4fea92fa66ca7f37945c] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp, totalSize=25.4 K 2023-03-07 10:55:31,607 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting f70d3690b0f447b49db6d7eb03105784, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678186512665 2023-03-07 10:55:31,607 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting fc1ba96d8b7d4bc88a13a242f8274347, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678186514447 2023-03-07 10:55:31,608 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting b95dd1783dc8473da64b71a3509c87e9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678186516242 2023-03-07 10:55:31,608 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 1655730916ad4fd5b519579e7665c10a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678186518050 2023-03-07 10:55:31,608 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 0ca90047dc8d4fea92fa66ca7f37945c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-07 10:55:31,619 INFO [Listener at localhost/42383] throttle.PressureAwareThroughputController(145): f26513f1f71767bd16ace3f43fa52372#family2#compaction#113 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:55:31,680 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/0fea123d4fd84d19af0a53225aafe303, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/b01a2447b583476cb287122573e8faba, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/daa094bed1bb4b02b9b348e0ec4b65ca, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/8973e2d015544df587456a0ca6168869, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/cf41cfbe186e42139dcf7cdf3a37a487] to archive 2023-03-07 10:55:31,681 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:31,682 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/0fea123d4fd84d19af0a53225aafe303 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/0fea123d4fd84d19af0a53225aafe303 2023-03-07 10:55:31,684 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/b01a2447b583476cb287122573e8faba to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/b01a2447b583476cb287122573e8faba 2023-03-07 10:55:31,685 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/daa094bed1bb4b02b9b348e0ec4b65ca to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/daa094bed1bb4b02b9b348e0ec4b65ca 2023-03-07 10:55:31,686 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/8973e2d015544df587456a0ca6168869 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/8973e2d015544df587456a0ca6168869 2023-03-07 10:55:31,687 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/cf41cfbe186e42139dcf7cdf3a37a487 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/cf41cfbe186e42139dcf7cdf3a37a487 2023-03-07 10:55:32,030 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230307a11289633e804c42aa939145f3c3ef6e_del 2023-03-07 10:55:32,030 INFO [Listener at localhost/42383] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230307a11289633e804c42aa939145f3c3ef6e_del to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230307a11289633e804c42aa939145f3c3ef6e_del 2023-03-07 10:55:32,844 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a693f35e1d546089bc32ac9d2e96262 2023-03-07 10:55:32,844 DEBUG [Listener at localhost/42383] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp/family2/1a693f35e1d546089bc32ac9d2e96262 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/1a693f35e1d546089bc32ac9d2e96262 2023-03-07 10:55:32,847 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a693f35e1d546089bc32ac9d2e96262 2023-03-07 10:55:32,848 INFO [Listener at localhost/42383] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f26513f1f71767bd16ace3f43fa52372/family2 of f26513f1f71767bd16ace3f43fa52372 into 1a693f35e1d546089bc32ac9d2e96262(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-07 10:55:32,848 DEBUG [Listener at localhost/42383] regionserver.HRegion(2289): Compaction status journal for f26513f1f71767bd16ace3f43fa52372: 2023-03-07 10:55:32,853 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-07 10:55:32,856 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-07 10:55:32,861 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-07 10:55:32,862 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-07 10:55:32,871 INFO [Listener at localhost/42383] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-07 10:55:32,880 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/f70d3690b0f447b49db6d7eb03105784, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/fc1ba96d8b7d4bc88a13a242f8274347, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/b95dd1783dc8473da64b71a3509c87e9, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/1655730916ad4fd5b519579e7665c10a, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/0ca90047dc8d4fea92fa66ca7f37945c] to archive 2023-03-07 10:55:32,880 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:32,882 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/f70d3690b0f447b49db6d7eb03105784 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/f70d3690b0f447b49db6d7eb03105784 2023-03-07 10:55:32,884 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/fc1ba96d8b7d4bc88a13a242f8274347 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/fc1ba96d8b7d4bc88a13a242f8274347 2023-03-07 10:55:32,885 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/b95dd1783dc8473da64b71a3509c87e9 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/b95dd1783dc8473da64b71a3509c87e9 2023-03-07 10:55:32,886 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/1655730916ad4fd5b519579e7665c10a to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/1655730916ad4fd5b519579e7665c10a 2023-03-07 10:55:32,888 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/0ca90047dc8d4fea92fa66ca7f37945c to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/0ca90047dc8d4fea92fa66ca7f37945c 2023-03-07 10:55:32,907 INFO [Listener at localhost/42383] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-03-07 10:55:32,910 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230307e4f338493d0242498b06440ad85acc78_del 2023-03-07 10:55:32,913 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230307ad7b708ff6ba4c2c8647133c8be2e1ca_del 2023-03-07 10:55:32,916 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303077d1bd83226e94d71b8b99ce68400418a_del 2023-03-07 10:55:32,916 INFO [Listener at localhost/42383] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-03-07 10:55:32,916 DEBUG [Listener at localhost/42383] zookeeper.ReadOnlyZKClient(139): Connect 0x567a176b to 127.0.0.1:56055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-07 10:55:32,921 DEBUG [Listener at localhost/42383] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5289509b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-07 10:55:32,921 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230307 for table='testCompactionWithHFileLink' and column='family1' 2023-03-07 10:55:32,921 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230307 for table='testCompactionWithHFileLink' and column='family1' 2023-03-07 10:55:32,921 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230307 for table='testCompactionWithHFileLink' and column='family1' 2023-03-07 10:55:33,007 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230307a01dd6d8b60344f3b2ca2ef8e5ed324f to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230307a01dd6d8b60344f3b2ca2ef8e5ed324f 2023-03-07 10:55:33,007 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023030734f69ba2442545848bced12a3d5e9d24 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023030734f69ba2442545848bced12a3d5e9d24 2023-03-07 10:55:33,008 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230307 table='testCompactionWithHFileLink' column='family1' 2023-03-07 10:55:33,008 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230307 table='testCompactionWithHFileLink' column='family1' 2023-03-07 10:55:33,029 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-07 10:55:33,035 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57070, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-07 10:55:33,042 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-07 10:55:33,044 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42962, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-07 10:55:33,056 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230307/family1/36b6c00c6a06411c8b6a1d71d02c923e first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-03-07 10:55:33,057 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230307/family1/9dc3806e4b1b4978a61c000201969cb0 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-03-07 10:55:33,057 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230307/family1/36b6c00c6a06411c8b6a1d71d02c923e}] 2023-03-07 10:55:33,059 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230307/family1/9dc3806e4b1b4978a61c000201969cb0}] 2023-03-07 10:55:33,064 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230307/family1/9dc3806e4b1b4978a61c000201969cb0 for inclusion in b443f7ebc46146a5bfe8850837317577/family1 2023-03-07 10:55:33,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230307/family1/36b6c00c6a06411c8b6a1d71d02c923e for inclusion in 0d21772dd37bba3b2c4b78b20a3c30e0/family1 2023-03-07 10:55:33,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-03-07 10:55:33,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(777): Region bounds: first= last=1 2023-03-07 10:55:33,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-03-07 10:55:33,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-07 10:55:33,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for 0d21772dd37bba3b2c4b78b20a3c30e0: 2023-03-07 10:55:33,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for b443f7ebc46146a5bfe8850837317577: 2023-03-07 10:55:33,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230307/family1/36b6c00c6a06411c8b6a1d71d02c923e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__jluusfjt3o2skdnosg19g9a5klilq23mfdp6i1k8383pf1gscf2g353mbevr7ich/family1/36b6c00c6a06411c8b6a1d71d02c923e 2023-03-07 10:55:33,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230307/family1/9dc3806e4b1b4978a61c000201969cb0 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__4f2d7g8k4gniijfkv95imk2422c3dkokscdbn3gfqgfmuau09m2rnj2gdmrolb2t/family1/9dc3806e4b1b4978a61c000201969cb0 2023-03-07 10:55:33,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__jluusfjt3o2skdnosg19g9a5klilq23mfdp6i1k8383pf1gscf2g353mbevr7ich/family1/36b6c00c6a06411c8b6a1d71d02c923e as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/40cb49f4b00f4062b7c4d0e16c870745_SeqId_29_ 2023-03-07 10:55:33,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__4f2d7g8k4gniijfkv95imk2422c3dkokscdbn3gfqgfmuau09m2rnj2gdmrolb2t/family1/9dc3806e4b1b4978a61c000201969cb0 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/89b40dd19b644022942e961cac619757_SeqId_29_ 2023-03-07 10:55:33,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__jluusfjt3o2skdnosg19g9a5klilq23mfdp6i1k8383pf1gscf2g353mbevr7ich/family1/36b6c00c6a06411c8b6a1d71d02c923e into 0d21772dd37bba3b2c4b78b20a3c30e0/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/40cb49f4b00f4062b7c4d0e16c870745_SeqId_29_ - updating store file list. 2023-03-07 10:55:33,070 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__4f2d7g8k4gniijfkv95imk2422c3dkokscdbn3gfqgfmuau09m2rnj2gdmrolb2t/family1/9dc3806e4b1b4978a61c000201969cb0 into b443f7ebc46146a5bfe8850837317577/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/89b40dd19b644022942e961cac619757_SeqId_29_ - updating store file list. 2023-03-07 10:55:33,073 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/89b40dd19b644022942e961cac619757_SeqId_29_ into b443f7ebc46146a5bfe8850837317577/family1 2023-03-07 10:55:33,073 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__4f2d7g8k4gniijfkv95imk2422c3dkokscdbn3gfqgfmuau09m2rnj2gdmrolb2t/family1/9dc3806e4b1b4978a61c000201969cb0 into b443f7ebc46146a5bfe8850837317577/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/89b40dd19b644022942e961cac619757_SeqId_29_) 2023-03-07 10:55:33,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/40cb49f4b00f4062b7c4d0e16c870745_SeqId_29_ into 0d21772dd37bba3b2c4b78b20a3c30e0/family1 2023-03-07 10:55:33,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__jluusfjt3o2skdnosg19g9a5klilq23mfdp6i1k8383pf1gscf2g353mbevr7ich/family1/36b6c00c6a06411c8b6a1d71d02c923e into 0d21772dd37bba3b2c4b78b20a3c30e0/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/40cb49f4b00f4062b7c4d0e16c870745_SeqId_29_) 2023-03-07 10:55:33,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__4f2d7g8k4gniijfkv95imk2422c3dkokscdbn3gfqgfmuau09m2rnj2gdmrolb2t/family1/9dc3806e4b1b4978a61c000201969cb0 2023-03-07 10:55:33,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__jluusfjt3o2skdnosg19g9a5klilq23mfdp6i1k8383pf1gscf2g353mbevr7ich/family1/36b6c00c6a06411c8b6a1d71d02c923e 2023-03-07 10:55:33,076 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230307 table='testCompactionWithHFileLink' column='family1' 2023-03-07 10:55:33,076 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230307 table='testCompactionWithHFileLink' column='family1' 2023-03-07 10:55:33,077 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:33,077 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:33,078 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023030707c2b04bd0454afe9f5ffe106c854973 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023030707c2b04bd0454afe9f5ffe106c854973 2023-03-07 10:55:33,078 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303072fbc14d87b0b4871bfaf045896222f60 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303072fbc14d87b0b4871bfaf045896222f60 2023-03-07 10:55:33,079 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230307113ba20ec7aa40c1a7dedda473e727ef to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230307113ba20ec7aa40c1a7dedda473e727ef 2023-03-07 10:55:33,079 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303073736dae9f7044ad8aebf6ed5bd19ceb6 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303073736dae9f7044ad8aebf6ed5bd19ceb6 2023-03-07 10:55:33,080 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230307aa1c312cc47f4c8caf0cc3707f1027d4 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230307aa1c312cc47f4c8caf0cc3707f1027d4 2023-03-07 10:55:33,080 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303074776994284e2411e9710ec77eb9e8c9c to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303074776994284e2411e9710ec77eb9e8c9c 2023-03-07 10:55:33,081 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230307faa4a20384264bcab422aee73cf4231b to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230307faa4a20384264bcab422aee73cf4231b 2023-03-07 10:55:33,081 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-07 10:55:33,081 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230307' 2023-03-07 10:55:33,081 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303074b0e28029e684108addabacca2b732e9 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303074b0e28029e684108addabacca2b732e9 2023-03-07 10:55:33,081 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-07 10:55:33,081 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230307' 2023-03-07 10:55:33,082 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230307 for table='testCompactionWithHFileLink' and column='family1' 2023-03-07 10:55:33,082 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230307 for table='testCompactionWithHFileLink' and column='family1' 2023-03-07 10:55:33,810 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230307edb6ad373178475b91ece8387812d8a3 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230307edb6ad373178475b91ece8387812d8a3 2023-03-07 10:55:33,811 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230307 table='testCompactionWithHFileLink' column='family1' 2023-03-07 10:55:33,835 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230307/family1/791076611a2e425aadbf04724e1f4b08 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-03-07 10:55:33,835 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230307/family1/791076611a2e425aadbf04724e1f4b08}] 2023-03-07 10:55:33,837 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230307/family1/791076611a2e425aadbf04724e1f4b08 for inclusion in f26513f1f71767bd16ace3f43fa52372/family1 2023-03-07 10:55:33,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-03-07 10:55:33,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-07 10:55:33,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for f26513f1f71767bd16ace3f43fa52372: 2023-03-07 10:55:33,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230307/family1/791076611a2e425aadbf04724e1f4b08 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__6cu1ugf2mkdij7jkfvi9dok3mqbf3hhlcdt4q3qqsuqqtd5a76godpqgo04eq6hs/family1/791076611a2e425aadbf04724e1f4b08 2023-03-07 10:55:33,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__6cu1ugf2mkdij7jkfvi9dok3mqbf3hhlcdt4q3qqsuqqtd5a76godpqgo04eq6hs/family1/791076611a2e425aadbf04724e1f4b08 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/e4e149a82f5d43d487e89f188492f22a_SeqId_29_ 2023-03-07 10:55:33,843 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__6cu1ugf2mkdij7jkfvi9dok3mqbf3hhlcdt4q3qqsuqqtd5a76godpqgo04eq6hs/family1/791076611a2e425aadbf04724e1f4b08 into f26513f1f71767bd16ace3f43fa52372/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/e4e149a82f5d43d487e89f188492f22a_SeqId_29_ - updating store file list. 2023-03-07 10:55:33,846 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/e4e149a82f5d43d487e89f188492f22a_SeqId_29_ into f26513f1f71767bd16ace3f43fa52372/family1 2023-03-07 10:55:33,846 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__6cu1ugf2mkdij7jkfvi9dok3mqbf3hhlcdt4q3qqsuqqtd5a76godpqgo04eq6hs/family1/791076611a2e425aadbf04724e1f4b08 into f26513f1f71767bd16ace3f43fa52372/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/e4e149a82f5d43d487e89f188492f22a_SeqId_29_) 2023-03-07 10:55:33,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__6cu1ugf2mkdij7jkfvi9dok3mqbf3hhlcdt4q3qqsuqqtd5a76godpqgo04eq6hs/family1/791076611a2e425aadbf04724e1f4b08 2023-03-07 10:55:33,848 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230307 table='testCompactionWithHFileLink' column='family1' 2023-03-07 10:55:33,849 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:33,850 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303070e1333264a4544428affb3bb698cf9ab to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303070e1333264a4544428affb3bb698cf9ab 2023-03-07 10:55:33,851 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230307bbd158cb8f784e08b5c8039b606cfbf2 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230307bbd158cb8f784e08b5c8039b606cfbf2 2023-03-07 10:55:33,851 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230307cfa2cbd6fec74dd4953ec0c6f2ebd3ea to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230307cfa2cbd6fec74dd4953ec0c6f2ebd3ea 2023-03-07 10:55:33,852 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230307deb08ef0574b42f2b1f5b31f390ce34e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230307deb08ef0574b42f2b1f5b31f390ce34e 2023-03-07 10:55:33,852 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-07 10:55:33,852 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230307' 2023-03-07 10:55:33,853 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230307 for table='testCompactionWithHFileLink' and column='family1' 2023-03-07 10:55:33,853 INFO [Listener at localhost/42383] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-03-07 10:55:33,853 INFO [Listener at localhost/42383] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-03-07 10:55:33,853 INFO [Listener at localhost/42383] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230307e4f338493d0242498b06440ad85acc78_del] 2023-03-07 10:55:33,853 DEBUG [Listener at localhost/42383] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:33,854 DEBUG [Listener at localhost/42383] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230307e4f338493d0242498b06440ad85acc78_del to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230307e4f338493d0242498b06440ad85acc78_del 2023-03-07 10:55:33,854 INFO [Listener at localhost/42383] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-07 10:55:33,854 INFO [Listener at localhost/42383] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230307ad7b708ff6ba4c2c8647133c8be2e1ca_del] 2023-03-07 10:55:33,855 DEBUG [Listener at localhost/42383] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:33,856 DEBUG [Listener at localhost/42383] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230307ad7b708ff6ba4c2c8647133c8be2e1ca_del to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230307ad7b708ff6ba4c2c8647133c8be2e1ca_del 2023-03-07 10:55:33,856 INFO [Listener at localhost/42383] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-07 10:55:33,856 INFO [Listener at localhost/42383] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303077d1bd83226e94d71b8b99ce68400418a_del] 2023-03-07 10:55:33,856 DEBUG [Listener at localhost/42383] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:33,857 DEBUG [Listener at localhost/42383] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303077d1bd83226e94d71b8b99ce68400418a_del to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303077d1bd83226e94d71b8b99ce68400418a_del 2023-03-07 10:55:33,857 INFO [Listener at localhost/42383] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-07 10:55:33,860 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-07 10:55:33,862 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-07 10:55:33,864 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-07 10:55:33,865 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-07 10:55:33,871 INFO [Listener at localhost/42383] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-03-07 10:55:33,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-03-07 10:55:33,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-03-07 10:55:33,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-07 10:55:33,874 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186533874"}]},"ts":"1678186533874"} 2023-03-07 10:55:33,875 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-03-07 10:55:33,879 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-03-07 10:55:33,879 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0d21772dd37bba3b2c4b78b20a3c30e0, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b443f7ebc46146a5bfe8850837317577, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f26513f1f71767bd16ace3f43fa52372, UNASSIGN}] 2023-03-07 10:55:33,881 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b443f7ebc46146a5bfe8850837317577, UNASSIGN 2023-03-07 10:55:33,881 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0d21772dd37bba3b2c4b78b20a3c30e0, UNASSIGN 2023-03-07 10:55:33,881 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f26513f1f71767bd16ace3f43fa52372, UNASSIGN 2023-03-07 10:55:33,881 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=b443f7ebc46146a5bfe8850837317577, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:33,882 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=0d21772dd37bba3b2c4b78b20a3c30e0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:33,882 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678186533881"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186533881"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186533881"}]},"ts":"1678186533881"} 2023-03-07 10:55:33,882 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678186533882"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186533882"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186533882"}]},"ts":"1678186533882"} 2023-03-07 10:55:33,882 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=f26513f1f71767bd16ace3f43fa52372, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:33,882 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678186533882"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186533882"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186533882"}]},"ts":"1678186533882"} 2023-03-07 10:55:33,883 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure b443f7ebc46146a5bfe8850837317577, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:55:33,883 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure 0d21772dd37bba3b2c4b78b20a3c30e0, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:55:33,884 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure f26513f1f71767bd16ace3f43fa52372, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:55:33,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-07 10:55:34,035 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 0d21772dd37bba3b2c4b78b20a3c30e0 2023-03-07 10:55:34,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0d21772dd37bba3b2c4b78b20a3c30e0, disabling compactions & flushes 2023-03-07 10:55:34,035 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:34,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:34,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. after waiting 0 ms 2023-03-07 10:55:34,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:34,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-07 10:55:34,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:34,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0d21772dd37bba3b2c4b78b20a3c30e0: 2023-03-07 10:55:34,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 0d21772dd37bba3b2c4b78b20a3c30e0 2023-03-07 10:55:34,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f26513f1f71767bd16ace3f43fa52372 2023-03-07 10:55:34,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f26513f1f71767bd16ace3f43fa52372, disabling compactions & flushes 2023-03-07 10:55:34,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:34,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:34,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. after waiting 0 ms 2023-03-07 10:55:34,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:34,042 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=0d21772dd37bba3b2c4b78b20a3c30e0, regionState=CLOSED 2023-03-07 10:55:34,042 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678186534042"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186534042"}]},"ts":"1678186534042"} 2023-03-07 10:55:34,044 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=89 2023-03-07 10:55:34,044 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure 0d21772dd37bba3b2c4b78b20a3c30e0, server=jenkins-hbase4.apache.org,39673,1678186416064 in 160 msec 2023-03-07 10:55:34,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-07 10:55:34,045 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0d21772dd37bba3b2c4b78b20a3c30e0, UNASSIGN in 165 msec 2023-03-07 10:55:34,046 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:34,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f26513f1f71767bd16ace3f43fa52372: 2023-03-07 10:55:34,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f26513f1f71767bd16ace3f43fa52372 2023-03-07 10:55:34,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b443f7ebc46146a5bfe8850837317577 2023-03-07 10:55:34,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b443f7ebc46146a5bfe8850837317577, disabling compactions & flushes 2023-03-07 10:55:34,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:34,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:34,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. after waiting 0 ms 2023-03-07 10:55:34,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:34,047 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=f26513f1f71767bd16ace3f43fa52372, regionState=CLOSED 2023-03-07 10:55:34,048 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678186534047"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186534047"}]},"ts":"1678186534047"} 2023-03-07 10:55:34,050 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-03-07 10:55:34,050 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; CloseRegionProcedure f26513f1f71767bd16ace3f43fa52372, server=jenkins-hbase4.apache.org,39673,1678186416064 in 165 msec 2023-03-07 10:55:34,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-07 10:55:34,051 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f26513f1f71767bd16ace3f43fa52372, UNASSIGN in 171 msec 2023-03-07 10:55:34,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:34,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b443f7ebc46146a5bfe8850837317577: 2023-03-07 10:55:34,053 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b443f7ebc46146a5bfe8850837317577 2023-03-07 10:55:34,053 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=b443f7ebc46146a5bfe8850837317577, regionState=CLOSED 2023-03-07 10:55:34,053 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678186534053"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186534053"}]},"ts":"1678186534053"} 2023-03-07 10:55:34,055 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-03-07 10:55:34,055 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure b443f7ebc46146a5bfe8850837317577, server=jenkins-hbase4.apache.org,39673,1678186416064 in 171 msec 2023-03-07 10:55:34,056 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=90, resume processing ppid=88 2023-03-07 10:55:34,056 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b443f7ebc46146a5bfe8850837317577, UNASSIGN in 176 msec 2023-03-07 10:55:34,057 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186534057"}]},"ts":"1678186534057"} 2023-03-07 10:55:34,058 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-03-07 10:55:34,059 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-03-07 10:55:34,061 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 189 msec 2023-03-07 10:55:34,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-07 10:55:34,176 INFO [Listener at localhost/42383] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-03-07 10:55:34,186 INFO [Listener at localhost/42383] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1678186519831-1678186534186 2023-03-07 10:55:34,187 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1678186519831-1678186534186 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-07 10:55:34,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1678186534187 (current time:1678186534187). 2023-03-07 10:55:34,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-03-07 10:55:34,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] zookeeper.ReadOnlyZKClient(139): Connect 0x0446301a to 127.0.0.1:56055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-07 10:55:34,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c2d4af4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-07 10:55:34,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-07 10:55:34,194 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35640, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-07 10:55:34,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0446301a to 127.0.0.1:56055 2023-03-07 10:55:34,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-07 10:55:34,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-03-07 10:55:34,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1678186519831-1678186534186 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-07 10:55:34,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-07 10:55:34,198 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-07 10:55:34,199 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1678187134199 2023-03-07 10:55:34,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1678186519831-1678186534186 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-07 10:55:34,199 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1678186519831-1678186534186 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-03-07 10:55:34,199 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1678186519831-1678186534186 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-03-07 10:55:34,199 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-03-07 10:55:34,299 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-07 10:55:34,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678186519831-1678186534186 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-07 10:55:34,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1678186519831-1678186534186 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-07 10:55:34,301 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-03-07 10:55:34,501 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-07 10:55:34,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678186519831-1678186534186 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-07 10:55:34,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1678186519831-1678186534186 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-07 10:55:34,502 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-03-07 10:55:34,605 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1678186519831-1678186534186 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-03-07 10:55:34,607 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-07 10:55:34,607 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-07 10:55:34,607 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-07 10:55:34,607 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-07 10:55:34,607 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-07 10:55:34,607 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-07 10:55:34,607 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-07 10:55:34,607 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-07 10:55:34,610 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/89b40dd19b644022942e961cac619757_SeqId_29_, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/be5a95b50dc643e89fadd00ff3828720] hfiles 2023-03-07 10:55:34,610 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/89b40dd19b644022942e961cac619757_SeqId_29_ 2023-03-07 10:55:34,610 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/be5a95b50dc643e89fadd00ff3828720 2023-03-07 10:55:34,610 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/9d49b245dccc47889db6f5ff68a25de4, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/e4e149a82f5d43d487e89f188492f22a_SeqId_29_] hfiles 2023-03-07 10:55:34,610 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/05b30b6132db41b3a340939ddb08ba80, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/40cb49f4b00f4062b7c4d0e16c870745_SeqId_29_] hfiles 2023-03-07 10:55:34,610 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/9d49b245dccc47889db6f5ff68a25de4 2023-03-07 10:55:34,610 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/05b30b6132db41b3a340939ddb08ba80 2023-03-07 10:55:34,610 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/e4e149a82f5d43d487e89f188492f22a_SeqId_29_ 2023-03-07 10:55:34,610 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/40cb49f4b00f4062b7c4d0e16c870745_SeqId_29_ 2023-03-07 10:55:34,610 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230307a01dd6d8b60344f3b2ca2ef8e5ed324f, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230307edb6ad373178475b91ece8387812d8a3, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023030734f69ba2442545848bced12a3d5e9d24] hfiles 2023-03-07 10:55:34,610 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230307a01dd6d8b60344f3b2ca2ef8e5ed324f 2023-03-07 10:55:34,611 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230307edb6ad373178475b91ece8387812d8a3 2023-03-07 10:55:34,611 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023030734f69ba2442545848bced12a3d5e9d24 2023-03-07 10:55:34,611 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/1a693f35e1d546089bc32ac9d2e96262] hfiles 2023-03-07 10:55:34,611 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/1a693f35e1d546089bc32ac9d2e96262 2023-03-07 10:55:34,611 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/7d4f05bc6c7d416eb4042dda5f218837] hfiles 2023-03-07 10:55:34,611 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/7d4f05bc6c7d416eb4042dda5f218837 2023-03-07 10:55:34,612 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/fa9f29c831de4822a76fdce95825faeb] hfiles 2023-03-07 10:55:34,612 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/fa9f29c831de4822a76fdce95825faeb 2023-03-07 10:55:34,618 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303071003135a9b3c4d298a17bc34eada6dd9, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303072358ec422ea148a1ae934755bcdf2f43, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230307740266b3b3b24e0f89807c29dff13c8f, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230307d1e88c70d48148d0ae421c3688506084, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230307dcf7c5d98d554121966f2ba61acdd195_del, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023030729d55aea989b444285ab12d6b89d38eb, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303072e759e67633342029e49a1fc41a803a9, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230307a11289633e804c42aa939145f3c3ef6e_del, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230307c0e1932178864f588591f3e3d65647e1, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230307fb1faf01485648ce937ba81a5bb30211, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023030769dad6365f5c4a4abbf063fdd95b2b92_del, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303079a884a6968b9404aae09675031ad3bc5, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230307cf8659d6b6dd45728cb137d0b2624478, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230307e6a29018b190472b85b8be15faa16732, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230307eb7afdedf72d4730b34452209c140600] hfiles 2023-03-07 10:55:34,618 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303071003135a9b3c4d298a17bc34eada6dd9 2023-03-07 10:55:34,618 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303072358ec422ea148a1ae934755bcdf2f43 2023-03-07 10:55:34,618 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230307740266b3b3b24e0f89807c29dff13c8f 2023-03-07 10:55:34,618 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230307d1e88c70d48148d0ae421c3688506084 2023-03-07 10:55:34,618 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230307dcf7c5d98d554121966f2ba61acdd195_del 2023-03-07 10:55:34,618 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023030729d55aea989b444285ab12d6b89d38eb 2023-03-07 10:55:34,618 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303072e759e67633342029e49a1fc41a803a9 2023-03-07 10:55:34,618 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230307a11289633e804c42aa939145f3c3ef6e_del 2023-03-07 10:55:34,618 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230307c0e1932178864f588591f3e3d65647e1 2023-03-07 10:55:34,618 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230307fb1faf01485648ce937ba81a5bb30211 2023-03-07 10:55:34,618 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023030769dad6365f5c4a4abbf063fdd95b2b92_del 2023-03-07 10:55:34,618 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303079a884a6968b9404aae09675031ad3bc5 2023-03-07 10:55:34,618 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230307cf8659d6b6dd45728cb137d0b2624478 2023-03-07 10:55:34,618 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230307e6a29018b190472b85b8be15faa16732 2023-03-07 10:55:34,618 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230307eb7afdedf72d4730b34452209c140600 2023-03-07 10:55:34,802 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-07 10:55:34,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678186519831-1678186534186 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-07 10:55:34,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1678186519831-1678186534186 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-07 10:55:34,804 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-03-07 10:55:35,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1678186519831-1678186534186 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-03-07 10:55:35,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1678186519831-1678186534186 2023-03-07 10:55:35,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1678186519831-1678186534186 2023-03-07 10:55:35,304 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-07 10:55:35,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678186519831-1678186534186 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-07 10:55:35,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1678186519831-1678186534186 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-07 10:55:35,305 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-03-07 10:55:35,456 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1678186519831-1678186534186 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.hbase-snapshot/hbase-failsafe-snaptb-1678186519831-1678186534186 2023-03-07 10:55:36,274 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1678186519831-1678186534186 of table testCompactionWithHFileLink completed 2023-03-07 10:55:36,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1678186519831-1678186534186 2023-03-07 10:55:36,274 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1678186519831-1678186534186 2023-03-07 10:55:36,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1678186519831-1678186534186 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1678186534199Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1678186519831-1678186534186 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1678186534606 (+407 ms)Consolidate snapshot: hbase-failsafe-snaptb-1678186519831-1678186534186 at 1678186535024 (+418 ms)Loading Region manifests for hbase-failsafe-snaptb-1678186519831-1678186534186 at 1678186535024Writing data manifest for hbase-failsafe-snaptb-1678186519831-1678186534186 at 1678186535027 (+3 ms)Verifying snapshot: hbase-failsafe-snaptb-1678186519831-1678186534186 at 1678186535433 (+406 ms)Snapshot hbase-failsafe-snaptb-1678186519831-1678186534186 of table testCompactionWithHFileLink completed at 1678186536274 (+841 ms) 2023-03-07 10:55:36,275 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-07 10:55:36,277 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 2.0780 sec 2023-03-07 10:55:36,305 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-07 10:55:36,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678186519831-1678186534186 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-07 10:55:36,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1678186519831-1678186534186 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-03-07 10:55:36,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1678186519831" table: "testCompactionWithHFileLink" creation_time: 1678186519841 type: FLUSH version: 2 ttl: 0 ) 2023-03-07 10:55:36,350 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1678186519831 as table=testCompactionWithHFileLink 2023-03-07 10:55:36,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-07 10:55:36,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-07 10:55:36,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-07 10:55:36,760 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-03-07 10:55:36,761 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-03-07 10:55:36,761 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-03-07 10:55:36,762 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(374): Starting restore snapshot={ ss=snaptb-1678186519831 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-07 10:55:36,766 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1678186519831" table: "testCompactionWithHFileLink" creation_time: 1678186519841 type: FLUSH version: 2 ttl: 0 2023-03-07 10:55:36,767 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink 2023-03-07 10:55:36,772 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-03-07 10:55:36,775 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023030734f69ba2442545848bced12a3d5e9d24 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023030734f69ba2442545848bced12a3d5e9d24 2023-03-07 10:55:36,776 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230307edb6ad373178475b91ece8387812d8a3 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230307edb6ad373178475b91ece8387812d8a3 2023-03-07 10:55:36,777 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230307a01dd6d8b60344f3b2ca2ef8e5ed324f to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230307a01dd6d8b60344f3b2ca2ef8e5ed324f 2023-03-07 10:55:36,777 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023030707c2b04bd0454afe9f5ffe106c854973 of snapshot=snaptb-1678186519831 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-07 10:55:36,780 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230307113ba20ec7aa40c1a7dedda473e727ef of snapshot=snaptb-1678186519831 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-07 10:55:36,783 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230307aa1c312cc47f4c8caf0cc3707f1027d4 of snapshot=snaptb-1678186519831 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-07 10:55:36,786 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230307faa4a20384264bcab422aee73cf4231b of snapshot=snaptb-1678186519831 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-07 10:55:36,789 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202303070e1333264a4544428affb3bb698cf9ab of snapshot=snaptb-1678186519831 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-07 10:55:36,791 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230307bbd158cb8f784e08b5c8039b606cfbf2 of snapshot=snaptb-1678186519831 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-07 10:55:36,794 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230307cfa2cbd6fec74dd4953ec0c6f2ebd3ea of snapshot=snaptb-1678186519831 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-07 10:55:36,798 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230307deb08ef0574b42f2b1f5b31f390ce34e of snapshot=snaptb-1678186519831 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-07 10:55:36,801 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202303072fbc14d87b0b4871bfaf045896222f60 of snapshot=snaptb-1678186519831 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-07 10:55:36,803 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202303073736dae9f7044ad8aebf6ed5bd19ceb6 of snapshot=snaptb-1678186519831 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-07 10:55:36,806 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202303074776994284e2411e9710ec77eb9e8c9c of snapshot=snaptb-1678186519831 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-07 10:55:36,809 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202303074b0e28029e684108addabacca2b732e9 of snapshot=snaptb-1678186519831 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-07 10:55:36,828 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230307dcf7c5d98d554121966f2ba61acdd195_del to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230307dcf7c5d98d554121966f2ba61acdd195_del 2023-03-07 10:55:36,829 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023030769dad6365f5c4a4abbf063fdd95b2b92_del to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023030769dad6365f5c4a4abbf063fdd95b2b92_del 2023-03-07 10:55:36,830 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230307a11289633e804c42aa939145f3c3ef6e_del to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230307a11289633e804c42aa939145f3c3ef6e_del 2023-03-07 10:55:36,831 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: 0d21772dd37bba3b2c4b78b20a3c30e0 2023-03-07 10:55:36,831 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: b443f7ebc46146a5bfe8850837317577 2023-03-07 10:55:36,831 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: f26513f1f71767bd16ace3f43fa52372 2023-03-07 10:55:36,834 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/e4e149a82f5d43d487e89f188492f22a_SeqId_29_ to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/e4e149a82f5d43d487e89f188492f22a_SeqId_29_ 2023-03-07 10:55:36,834 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/05b30b6132db41b3a340939ddb08ba80 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/05b30b6132db41b3a340939ddb08ba80 2023-03-07 10:55:36,835 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/9d49b245dccc47889db6f5ff68a25de4 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/9d49b245dccc47889db6f5ff68a25de4 2023-03-07 10:55:36,836 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0fea123d4fd84d19af0a53225aafe303 of snapshot=snaptb-1678186519831 to region=f26513f1f71767bd16ace3f43fa52372 table=testCompactionWithHFileLink 2023-03-07 10:55:36,836 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/40cb49f4b00f4062b7c4d0e16c870745_SeqId_29_ to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/40cb49f4b00f4062b7c4d0e16c870745_SeqId_29_ 2023-03-07 10:55:36,836 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 385bfcef9cf24048be847a094f25a7ca of snapshot=snaptb-1678186519831 to region=0d21772dd37bba3b2c4b78b20a3c30e0 table=testCompactionWithHFileLink 2023-03-07 10:55:36,836 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/be5a95b50dc643e89fadd00ff3828720 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/be5a95b50dc643e89fadd00ff3828720 2023-03-07 10:55:36,838 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/89b40dd19b644022942e961cac619757_SeqId_29_ to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/89b40dd19b644022942e961cac619757_SeqId_29_ 2023-03-07 10:55:36,838 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cb481fb954494136b4a726a0ab103581 of snapshot=snaptb-1678186519831 to region=b443f7ebc46146a5bfe8850837317577 table=testCompactionWithHFileLink 2023-03-07 10:55:36,841 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b01a2447b583476cb287122573e8faba of snapshot=snaptb-1678186519831 to region=f26513f1f71767bd16ace3f43fa52372 table=testCompactionWithHFileLink 2023-03-07 10:55:36,842 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d8c20ccc995d4822aa0a6447ed64c0ba of snapshot=snaptb-1678186519831 to region=0d21772dd37bba3b2c4b78b20a3c30e0 table=testCompactionWithHFileLink 2023-03-07 10:55:36,843 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d21bb01241d24ac2b565a7adbdf4723e of snapshot=snaptb-1678186519831 to region=b443f7ebc46146a5bfe8850837317577 table=testCompactionWithHFileLink 2023-03-07 10:55:36,845 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink daa094bed1bb4b02b9b348e0ec4b65ca of snapshot=snaptb-1678186519831 to region=f26513f1f71767bd16ace3f43fa52372 table=testCompactionWithHFileLink 2023-03-07 10:55:36,845 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ba05f2f176834c0295bd4c13661b2057 of snapshot=snaptb-1678186519831 to region=0d21772dd37bba3b2c4b78b20a3c30e0 table=testCompactionWithHFileLink 2023-03-07 10:55:36,847 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9f3590c6a938489a8c6dee641c847d93 of snapshot=snaptb-1678186519831 to region=b443f7ebc46146a5bfe8850837317577 table=testCompactionWithHFileLink 2023-03-07 10:55:36,848 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8973e2d015544df587456a0ca6168869 of snapshot=snaptb-1678186519831 to region=f26513f1f71767bd16ace3f43fa52372 table=testCompactionWithHFileLink 2023-03-07 10:55:36,848 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4d783e473cfd49c6a011ff93a846341e of snapshot=snaptb-1678186519831 to region=0d21772dd37bba3b2c4b78b20a3c30e0 table=testCompactionWithHFileLink 2023-03-07 10:55:36,850 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 08f3422db7d44740879de03c5cf14cc5 of snapshot=snaptb-1678186519831 to region=b443f7ebc46146a5bfe8850837317577 table=testCompactionWithHFileLink 2023-03-07 10:55:36,853 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/1a693f35e1d546089bc32ac9d2e96262 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/1a693f35e1d546089bc32ac9d2e96262 2023-03-07 10:55:36,853 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f70d3690b0f447b49db6d7eb03105784 of snapshot=snaptb-1678186519831 to region=f26513f1f71767bd16ace3f43fa52372 table=testCompactionWithHFileLink 2023-03-07 10:55:36,854 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/7d4f05bc6c7d416eb4042dda5f218837 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/7d4f05bc6c7d416eb4042dda5f218837 2023-03-07 10:55:36,854 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4a61a5e4bafc4924b54fb3680d1bf155 of snapshot=snaptb-1678186519831 to region=0d21772dd37bba3b2c4b78b20a3c30e0 table=testCompactionWithHFileLink 2023-03-07 10:55:36,856 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/fa9f29c831de4822a76fdce95825faeb to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/fa9f29c831de4822a76fdce95825faeb 2023-03-07 10:55:36,856 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 155cce75e6a1420499a693f041db2a8a of snapshot=snaptb-1678186519831 to region=b443f7ebc46146a5bfe8850837317577 table=testCompactionWithHFileLink 2023-03-07 10:55:36,857 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fc1ba96d8b7d4bc88a13a242f8274347 of snapshot=snaptb-1678186519831 to region=f26513f1f71767bd16ace3f43fa52372 table=testCompactionWithHFileLink 2023-03-07 10:55:36,857 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d4c9be19609b4018b7e188ac1153e94f of snapshot=snaptb-1678186519831 to region=0d21772dd37bba3b2c4b78b20a3c30e0 table=testCompactionWithHFileLink 2023-03-07 10:55:36,860 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ddd7d6d0122b4ae4aa75ab21a617e772 of snapshot=snaptb-1678186519831 to region=b443f7ebc46146a5bfe8850837317577 table=testCompactionWithHFileLink 2023-03-07 10:55:36,860 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b95dd1783dc8473da64b71a3509c87e9 of snapshot=snaptb-1678186519831 to region=f26513f1f71767bd16ace3f43fa52372 table=testCompactionWithHFileLink 2023-03-07 10:55:36,860 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3f49ab0c8c2144ec9a92aa1f89b8c5f4 of snapshot=snaptb-1678186519831 to region=0d21772dd37bba3b2c4b78b20a3c30e0 table=testCompactionWithHFileLink 2023-03-07 10:55:36,864 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ebb55b1118234afc9d6e873a5355090c of snapshot=snaptb-1678186519831 to region=b443f7ebc46146a5bfe8850837317577 table=testCompactionWithHFileLink 2023-03-07 10:55:36,864 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1655730916ad4fd5b519579e7665c10a of snapshot=snaptb-1678186519831 to region=f26513f1f71767bd16ace3f43fa52372 table=testCompactionWithHFileLink 2023-03-07 10:55:36,864 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5d65e859364a4b6ab723f7c7a44d2a4b of snapshot=snaptb-1678186519831 to region=0d21772dd37bba3b2c4b78b20a3c30e0 table=testCompactionWithHFileLink 2023-03-07 10:55:36,867 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 765bba2f4b744b85b2b6f28fbf7a3f6f of snapshot=snaptb-1678186519831 to region=b443f7ebc46146a5bfe8850837317577 table=testCompactionWithHFileLink 2023-03-07 10:55:36,870 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1678186519831" table: "testCompactionWithHFileLink" creation_time: 1678186519841 type: FLUSH version: 2 ttl: 0 2023-03-07 10:55:36,871 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1678186536871"}]},"ts":"9223372036854775807"} 2023-03-07 10:55:36,871 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1678186536871"}]},"ts":"9223372036854775807"} 2023-03-07 10:55:36,871 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1678186536871"}]},"ts":"9223372036854775807"} 2023-03-07 10:55:36,873 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-03-07 10:55:36,873 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0d21772dd37bba3b2c4b78b20a3c30e0, NAME => 'testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b443f7ebc46146a5bfe8850837317577, NAME => 'testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => f26513f1f71767bd16ace3f43fa52372, NAME => 'testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372.', STARTKEY => '2', ENDKEY => ''}] 2023-03-07 10:55:36,873 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678186536872"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186536872"}]},"ts":"1678186536872"} 2023-03-07 10:55:36,873 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678186536872"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186536872"}]},"ts":"1678186536872"} 2023-03-07 10:55:36,873 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678186536872"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186536872"}]},"ts":"1678186536872"} 2023-03-07 10:55:36,875 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-07 10:55:36,875 INFO [PEWorker-5] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-03-07 10:55:36,875 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 0d21772dd37bba3b2c4b78b20a3c30e0, NAME => 'testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b443f7ebc46146a5bfe8850837317577, NAME => 'testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => f26513f1f71767bd16ace3f43fa52372, NAME => 'testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372.', STARTKEY => '2', ENDKEY => ''}] 2023-03-07 10:55:36,875 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(447): Restore snapshot={ ss=snaptb-1678186519831 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-03-07 10:55:36,877 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1678186519831" table: "testCompactionWithHFileLink" creation_time: 1678186519841 type: FLUSH version: 2 ttl: 0 ) in 535 msec 2023-03-07 10:55:36,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-07 10:55:36,956 INFO [Listener at localhost/42383] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-03-07 10:55:36,957 INFO [Listener at localhost/42383] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1678186519831-1678186534186 2023-03-07 10:55:36,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1678186519831-1678186534186" 2023-03-07 10:55:36,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1678186519831-1678186534186 2023-03-07 10:55:36,965 INFO [Listener at localhost/42383] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-03-07 10:55:36,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-03-07 10:55:36,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-03-07 10:55:36,977 INFO [PEWorker-2] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-03-07 10:55:36,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-07 10:55:36,978 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186536978"}]},"ts":"1678186536978"} 2023-03-07 10:55:36,979 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-03-07 10:55:36,982 DEBUG [PEWorker-2] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-03-07 10:55:36,982 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0d21772dd37bba3b2c4b78b20a3c30e0, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b443f7ebc46146a5bfe8850837317577, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f26513f1f71767bd16ace3f43fa52372, ASSIGN}] 2023-03-07 10:55:36,983 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b443f7ebc46146a5bfe8850837317577, ASSIGN 2023-03-07 10:55:36,983 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f26513f1f71767bd16ace3f43fa52372, ASSIGN 2023-03-07 10:55:36,983 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0d21772dd37bba3b2c4b78b20a3c30e0, ASSIGN 2023-03-07 10:55:36,984 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b443f7ebc46146a5bfe8850837317577, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-07 10:55:36,984 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0d21772dd37bba3b2c4b78b20a3c30e0, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-07 10:55:36,984 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f26513f1f71767bd16ace3f43fa52372, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-07 10:55:37,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-07 10:55:37,136 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=b443f7ebc46146a5bfe8850837317577, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:37,136 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=0d21772dd37bba3b2c4b78b20a3c30e0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:37,136 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=f26513f1f71767bd16ace3f43fa52372, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:37,136 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678186537136"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186537136"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186537136"}]},"ts":"1678186537136"} 2023-03-07 10:55:37,136 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678186537136"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186537136"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186537136"}]},"ts":"1678186537136"} 2023-03-07 10:55:37,136 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678186537136"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186537136"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186537136"}]},"ts":"1678186537136"} 2023-03-07 10:55:37,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=99, state=RUNNABLE; OpenRegionProcedure b443f7ebc46146a5bfe8850837317577, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:55:37,138 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=98, state=RUNNABLE; OpenRegionProcedure 0d21772dd37bba3b2c4b78b20a3c30e0, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:55:37,139 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; OpenRegionProcedure f26513f1f71767bd16ace3f43fa52372, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:55:37,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-07 10:55:37,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:37,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f26513f1f71767bd16ace3f43fa52372, NAME => 'testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372.', STARTKEY => '2', ENDKEY => ''} 2023-03-07 10:55:37,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink f26513f1f71767bd16ace3f43fa52372 2023-03-07 10:55:37,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:55:37,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f26513f1f71767bd16ace3f43fa52372 2023-03-07 10:55:37,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f26513f1f71767bd16ace3f43fa52372 2023-03-07 10:55:37,293 INFO [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f26513f1f71767bd16ace3f43fa52372 2023-03-07 10:55:37,294 DEBUG [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1 2023-03-07 10:55:37,294 DEBUG [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1 2023-03-07 10:55:37,295 INFO [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f26513f1f71767bd16ace3f43fa52372 columnFamilyName family1 2023-03-07 10:55:37,306 DEBUG [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-0fea123d4fd84d19af0a53225aafe303 2023-03-07 10:55:37,311 DEBUG [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-8973e2d015544df587456a0ca6168869 2023-03-07 10:55:37,316 DEBUG [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-b01a2447b583476cb287122573e8faba 2023-03-07 10:55:37,321 DEBUG [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-daa094bed1bb4b02b9b348e0ec4b65ca 2023-03-07 10:55:37,322 INFO [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] regionserver.HStore(310): Store=f26513f1f71767bd16ace3f43fa52372/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:55:37,322 INFO [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f26513f1f71767bd16ace3f43fa52372 2023-03-07 10:55:37,323 DEBUG [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2 2023-03-07 10:55:37,323 DEBUG [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2 2023-03-07 10:55:37,323 INFO [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f26513f1f71767bd16ace3f43fa52372 columnFamilyName family2 2023-03-07 10:55:37,330 DEBUG [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-1655730916ad4fd5b519579e7665c10a 2023-03-07 10:55:37,334 DEBUG [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-b95dd1783dc8473da64b71a3509c87e9 2023-03-07 10:55:37,340 DEBUG [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-f70d3690b0f447b49db6d7eb03105784 2023-03-07 10:55:37,346 DEBUG [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-fc1ba96d8b7d4bc88a13a242f8274347 2023-03-07 10:55:37,346 INFO [StoreOpener-f26513f1f71767bd16ace3f43fa52372-1] regionserver.HStore(310): Store=f26513f1f71767bd16ace3f43fa52372/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:55:37,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372 2023-03-07 10:55:37,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372 2023-03-07 10:55:37,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-07 10:55:37,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f26513f1f71767bd16ace3f43fa52372 2023-03-07 10:55:37,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f26513f1f71767bd16ace3f43fa52372; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74802281, jitterRate=0.11464084684848785}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-07 10:55:37,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f26513f1f71767bd16ace3f43fa52372: 2023-03-07 10:55:37,353 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372., pid=103, masterSystemTime=1678186537289 2023-03-07 10:55:37,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:55:37,354 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-07 10:55:37,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:55:37,354 DEBUG [RS:0;jenkins-hbase4:39673-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-07 10:55:37,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:37,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:37,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:37,356 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=f26513f1f71767bd16ace3f43fa52372, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:37,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0d21772dd37bba3b2c4b78b20a3c30e0, NAME => 'testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0.', STARTKEY => '', ENDKEY => '1'} 2023-03-07 10:55:37,356 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678186537355"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186537355"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186537355"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186537355"}]},"ts":"1678186537355"} 2023-03-07 10:55:37,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 0d21772dd37bba3b2c4b78b20a3c30e0 2023-03-07 10:55:37,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:55:37,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0d21772dd37bba3b2c4b78b20a3c30e0 2023-03-07 10:55:37,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0d21772dd37bba3b2c4b78b20a3c30e0 2023-03-07 10:55:37,356 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-07 10:55:37,356 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1912): f26513f1f71767bd16ace3f43fa52372/family1 is initiating minor compaction (all files) 2023-03-07 10:55:37,356 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f26513f1f71767bd16ace3f43fa52372/family1 in testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:37,357 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-0fea123d4fd84d19af0a53225aafe303, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-b01a2447b583476cb287122573e8faba, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-daa094bed1bb4b02b9b348e0ec4b65ca, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-8973e2d015544df587456a0ca6168869] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp, totalSize=21.6 K 2023-03-07 10:55:37,358 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-0fea123d4fd84d19af0a53225aafe303, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678186512665 2023-03-07 10:55:37,359 INFO [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0d21772dd37bba3b2c4b78b20a3c30e0 2023-03-07 10:55:37,359 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-b01a2447b583476cb287122573e8faba, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678186514447 2023-03-07 10:55:37,359 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-03-07 10:55:37,359 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; OpenRegionProcedure f26513f1f71767bd16ace3f43fa52372, server=jenkins-hbase4.apache.org,39673,1678186416064 in 218 msec 2023-03-07 10:55:37,359 DEBUG [RS:0;jenkins-hbase4:39673-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-07 10:55:37,360 DEBUG [RS:0;jenkins-hbase4:39673-longCompactions-0] regionserver.HStore(1912): f26513f1f71767bd16ace3f43fa52372/family2 is initiating minor compaction (all files) 2023-03-07 10:55:37,360 INFO [RS:0;jenkins-hbase4:39673-longCompactions-0] regionserver.HRegion(2259): Starting compaction of f26513f1f71767bd16ace3f43fa52372/family2 in testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:55:37,360 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-daa094bed1bb4b02b9b348e0ec4b65ca, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678186516242 2023-03-07 10:55:37,360 INFO [RS:0;jenkins-hbase4:39673-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-f70d3690b0f447b49db6d7eb03105784, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-fc1ba96d8b7d4bc88a13a242f8274347, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-b95dd1783dc8473da64b71a3509c87e9, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-1655730916ad4fd5b519579e7665c10a] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp, totalSize=20.4 K 2023-03-07 10:55:37,360 DEBUG [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1 2023-03-07 10:55:37,360 DEBUG [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1 2023-03-07 10:55:37,361 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-8973e2d015544df587456a0ca6168869, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678186518050 2023-03-07 10:55:37,361 INFO [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d21772dd37bba3b2c4b78b20a3c30e0 columnFamilyName family1 2023-03-07 10:55:37,361 DEBUG [RS:0;jenkins-hbase4:39673-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-f70d3690b0f447b49db6d7eb03105784, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678186512665 2023-03-07 10:55:37,361 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f26513f1f71767bd16ace3f43fa52372, ASSIGN in 377 msec 2023-03-07 10:55:37,363 DEBUG [RS:0;jenkins-hbase4:39673-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-fc1ba96d8b7d4bc88a13a242f8274347, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678186514447 2023-03-07 10:55:37,364 DEBUG [RS:0;jenkins-hbase4:39673-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-b95dd1783dc8473da64b71a3509c87e9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678186516242 2023-03-07 10:55:37,366 DEBUG [RS:0;jenkins-hbase4:39673-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-1655730916ad4fd5b519579e7665c10a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678186518050 2023-03-07 10:55:37,379 DEBUG [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-385bfcef9cf24048be847a094f25a7ca 2023-03-07 10:55:37,390 DEBUG [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-4d783e473cfd49c6a011ff93a846341e 2023-03-07 10:55:37,405 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] throttle.PressureAwareThroughputController(145): f26513f1f71767bd16ace3f43fa52372#family1#compaction#114 average throughput is 0.26 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-03-07 10:55:37,406 DEBUG [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-ba05f2f176834c0295bd4c13661b2057 2023-03-07 10:55:37,416 INFO [RS:0;jenkins-hbase4:39673-longCompactions-0] throttle.PressureAwareThroughputController(145): f26513f1f71767bd16ace3f43fa52372#family2#compaction#115 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-03-07 10:55:37,433 DEBUG [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-d8c20ccc995d4822aa0a6447ed64c0ba 2023-03-07 10:55:37,434 INFO [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] regionserver.HStore(310): Store=0d21772dd37bba3b2c4b78b20a3c30e0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:55:37,434 INFO [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0d21772dd37bba3b2c4b78b20a3c30e0 2023-03-07 10:55:37,435 DEBUG [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2 2023-03-07 10:55:37,435 DEBUG [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2 2023-03-07 10:55:37,435 INFO [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d21772dd37bba3b2c4b78b20a3c30e0 columnFamilyName family2 2023-03-07 10:55:37,444 DEBUG [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-3f49ab0c8c2144ec9a92aa1f89b8c5f4 2023-03-07 10:55:37,448 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp/family1/b4b844a07c01429fa011289450d04894 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/b4b844a07c01429fa011289450d04894 2023-03-07 10:55:37,449 DEBUG [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-4a61a5e4bafc4924b54fb3680d1bf155 2023-03-07 10:55:37,453 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in f26513f1f71767bd16ace3f43fa52372/family1 of f26513f1f71767bd16ace3f43fa52372 into b4b844a07c01429fa011289450d04894(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-07 10:55:37,453 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f26513f1f71767bd16ace3f43fa52372: 2023-03-07 10:55:37,453 DEBUG [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-5d65e859364a4b6ab723f7c7a44d2a4b 2023-03-07 10:55:37,453 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372., storeName=f26513f1f71767bd16ace3f43fa52372/family1, priority=12, startTime=1678186537353; duration=0sec 2023-03-07 10:55:37,453 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:55:37,457 DEBUG [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-d4c9be19609b4018b7e188ac1153e94f 2023-03-07 10:55:37,457 INFO [StoreOpener-0d21772dd37bba3b2c4b78b20a3c30e0-1] regionserver.HStore(310): Store=0d21772dd37bba3b2c4b78b20a3c30e0/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:55:37,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0 2023-03-07 10:55:37,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0 2023-03-07 10:55:37,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-07 10:55:37,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0d21772dd37bba3b2c4b78b20a3c30e0 2023-03-07 10:55:37,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0d21772dd37bba3b2c4b78b20a3c30e0; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65066036, jitterRate=-0.03044050931930542}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-07 10:55:37,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0d21772dd37bba3b2c4b78b20a3c30e0: 2023-03-07 10:55:37,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0., pid=102, masterSystemTime=1678186537289 2023-03-07 10:55:37,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:55:37,463 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-07 10:55:37,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-07 10:55:37,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:37,464 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:37,465 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:37,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b443f7ebc46146a5bfe8850837317577, NAME => 'testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577.', STARTKEY => '1', ENDKEY => '2'} 2023-03-07 10:55:37,465 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=0d21772dd37bba3b2c4b78b20a3c30e0, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:37,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink b443f7ebc46146a5bfe8850837317577 2023-03-07 10:55:37,465 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678186537465"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186537465"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186537465"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186537465"}]},"ts":"1678186537465"} 2023-03-07 10:55:37,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:55:37,465 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-07 10:55:37,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b443f7ebc46146a5bfe8850837317577 2023-03-07 10:55:37,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b443f7ebc46146a5bfe8850837317577 2023-03-07 10:55:37,465 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1912): 0d21772dd37bba3b2c4b78b20a3c30e0/family1 is initiating minor compaction (all files) 2023-03-07 10:55:37,465 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0d21772dd37bba3b2c4b78b20a3c30e0/family1 in testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:37,465 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-385bfcef9cf24048be847a094f25a7ca, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-d8c20ccc995d4822aa0a6447ed64c0ba, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-ba05f2f176834c0295bd4c13661b2057, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-4d783e473cfd49c6a011ff93a846341e] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp, totalSize=21.6 K 2023-03-07 10:55:37,466 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-385bfcef9cf24048be847a094f25a7ca, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678186512662 2023-03-07 10:55:37,466 INFO [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b443f7ebc46146a5bfe8850837317577 2023-03-07 10:55:37,467 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-d8c20ccc995d4822aa0a6447ed64c0ba, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678186514447 2023-03-07 10:55:37,467 DEBUG [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1 2023-03-07 10:55:37,468 DEBUG [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1 2023-03-07 10:55:37,468 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-ba05f2f176834c0295bd4c13661b2057, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678186516241 2023-03-07 10:55:37,468 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=98 2023-03-07 10:55:37,468 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=98, state=SUCCESS; OpenRegionProcedure 0d21772dd37bba3b2c4b78b20a3c30e0, server=jenkins-hbase4.apache.org,39673,1678186416064 in 328 msec 2023-03-07 10:55:37,468 INFO [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b443f7ebc46146a5bfe8850837317577 columnFamilyName family1 2023-03-07 10:55:37,469 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-4d783e473cfd49c6a011ff93a846341e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678186518049 2023-03-07 10:55:37,469 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0d21772dd37bba3b2c4b78b20a3c30e0, ASSIGN in 486 msec 2023-03-07 10:55:37,475 DEBUG [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-08f3422db7d44740879de03c5cf14cc5 2023-03-07 10:55:37,479 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-0fea123d4fd84d19af0a53225aafe303, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-b01a2447b583476cb287122573e8faba, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-daa094bed1bb4b02b9b348e0ec4b65ca, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-8973e2d015544df587456a0ca6168869] to archive 2023-03-07 10:55:37,479 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:37,481 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-0fea123d4fd84d19af0a53225aafe303 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-0fea123d4fd84d19af0a53225aafe303 2023-03-07 10:55:37,482 DEBUG [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-9f3590c6a938489a8c6dee641c847d93 2023-03-07 10:55:37,483 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-b01a2447b583476cb287122573e8faba to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-b01a2447b583476cb287122573e8faba 2023-03-07 10:55:37,484 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-daa094bed1bb4b02b9b348e0ec4b65ca to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-daa094bed1bb4b02b9b348e0ec4b65ca 2023-03-07 10:55:37,485 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-8973e2d015544df587456a0ca6168869 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-8973e2d015544df587456a0ca6168869 2023-03-07 10:55:37,489 DEBUG [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-cb481fb954494136b4a726a0ab103581 2023-03-07 10:55:37,500 DEBUG [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-d21bb01241d24ac2b565a7adbdf4723e 2023-03-07 10:55:37,500 INFO [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] regionserver.HStore(310): Store=b443f7ebc46146a5bfe8850837317577/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:55:37,500 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0d21772dd37bba3b2c4b78b20a3c30e0#family1#compaction#116 average throughput is 0.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-03-07 10:55:37,500 INFO [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b443f7ebc46146a5bfe8850837317577 2023-03-07 10:55:37,501 DEBUG [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2 2023-03-07 10:55:37,501 DEBUG [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2 2023-03-07 10:55:37,501 INFO [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b443f7ebc46146a5bfe8850837317577 columnFamilyName family2 2023-03-07 10:55:37,516 DEBUG [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-155cce75e6a1420499a693f041db2a8a 2023-03-07 10:55:37,524 DEBUG [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-765bba2f4b744b85b2b6f28fbf7a3f6f 2023-03-07 10:55:37,530 DEBUG [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-ddd7d6d0122b4ae4aa75ab21a617e772 2023-03-07 10:55:37,540 DEBUG [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] regionserver.HStore(539): loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-ebb55b1118234afc9d6e873a5355090c 2023-03-07 10:55:37,540 INFO [StoreOpener-b443f7ebc46146a5bfe8850837317577-1] regionserver.HStore(310): Store=b443f7ebc46146a5bfe8850837317577/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:55:37,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577 2023-03-07 10:55:37,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577 2023-03-07 10:55:37,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-07 10:55:37,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b443f7ebc46146a5bfe8850837317577 2023-03-07 10:55:37,545 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b443f7ebc46146a5bfe8850837317577; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61688163, jitterRate=-0.08077473938465118}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-07 10:55:37,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b443f7ebc46146a5bfe8850837317577: 2023-03-07 10:55:37,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577., pid=101, masterSystemTime=1678186537289 2023-03-07 10:55:37,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-07 10:55:37,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-07 10:55:37,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:37,547 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:37,548 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=b443f7ebc46146a5bfe8850837317577, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:37,548 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678186537548"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186537548"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186537548"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186537548"}]},"ts":"1678186537548"} 2023-03-07 10:55:37,550 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-03-07 10:55:37,551 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; OpenRegionProcedure b443f7ebc46146a5bfe8850837317577, server=jenkins-hbase4.apache.org,39673,1678186416064 in 411 msec 2023-03-07 10:55:37,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=99, resume processing ppid=97 2023-03-07 10:55:37,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b443f7ebc46146a5bfe8850837317577, ASSIGN in 568 msec 2023-03-07 10:55:37,553 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186537552"}]},"ts":"1678186537552"} 2023-03-07 10:55:37,554 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-03-07 10:55:37,555 INFO [PEWorker-1] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-03-07 10:55:37,556 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 585 msec 2023-03-07 10:55:37,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-07 10:55:37,581 INFO [Listener at localhost/42383] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-03-07 10:55:37,592 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-07 10:55:37,602 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-07 10:55:37,609 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-07 10:55:37,610 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-07 10:55:37,616 INFO [Listener at localhost/42383] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-07 10:55:37,631 INFO [Listener at localhost/42383] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-03-07 10:55:37,632 INFO [Listener at localhost/42383] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-03-07 10:55:37,632 DEBUG [Listener at localhost/42383] zookeeper.ReadOnlyZKClient(139): Connect 0x7c07c47c to 127.0.0.1:56055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-07 10:55:37,636 DEBUG [Listener at localhost/42383] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@683e65d4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-07 10:55:37,637 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230307 for table='testCompactionWithHFileLink' and column='family1' 2023-03-07 10:55:37,637 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230307 for table='testCompactionWithHFileLink' and column='family1' 2023-03-07 10:55:37,637 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230307 for table='testCompactionWithHFileLink' and column='family1' 2023-03-07 10:55:38,120 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230307842221f6f07240a6a7e7d3c67ba0118c to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230307842221f6f07240a6a7e7d3c67ba0118c 2023-03-07 10:55:38,121 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230307 table='testCompactionWithHFileLink' column='family1' 2023-03-07 10:55:38,133 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-07 10:55:38,136 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35642, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-07 10:55:38,143 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-07 10:55:38,153 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60614, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-07 10:55:38,165 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230307/family1/a40bb74c83d34be9b459af6ac592292e first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-03-07 10:55:38,166 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230307/family1/a40bb74c83d34be9b459af6ac592292e}] 2023-03-07 10:55:38,174 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230307/family1/a40bb74c83d34be9b459af6ac592292e for inclusion in f26513f1f71767bd16ace3f43fa52372/family1 2023-03-07 10:55:38,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-03-07 10:55:38,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-07 10:55:38,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for f26513f1f71767bd16ace3f43fa52372: 2023-03-07 10:55:38,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230307/family1/a40bb74c83d34be9b459af6ac592292e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__dkt0rf6fu8b60c0eara5udg7p0mi63pm2jjl1ari6uipl5vabtp7q8lo23v54c0/family1/a40bb74c83d34be9b459af6ac592292e 2023-03-07 10:55:38,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__dkt0rf6fu8b60c0eara5udg7p0mi63pm2jjl1ari6uipl5vabtp7q8lo23v54c0/family1/a40bb74c83d34be9b459af6ac592292e as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/e4409b09aa5348af86b630de086be835_SeqId_35_ 2023-03-07 10:55:38,179 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__dkt0rf6fu8b60c0eara5udg7p0mi63pm2jjl1ari6uipl5vabtp7q8lo23v54c0/family1/a40bb74c83d34be9b459af6ac592292e into f26513f1f71767bd16ace3f43fa52372/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/e4409b09aa5348af86b630de086be835_SeqId_35_ - updating store file list. 2023-03-07 10:55:38,182 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/e4409b09aa5348af86b630de086be835_SeqId_35_ into f26513f1f71767bd16ace3f43fa52372/family1 2023-03-07 10:55:38,182 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__dkt0rf6fu8b60c0eara5udg7p0mi63pm2jjl1ari6uipl5vabtp7q8lo23v54c0/family1/a40bb74c83d34be9b459af6ac592292e into f26513f1f71767bd16ace3f43fa52372/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family1/e4409b09aa5348af86b630de086be835_SeqId_35_) 2023-03-07 10:55:38,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__dkt0rf6fu8b60c0eara5udg7p0mi63pm2jjl1ari6uipl5vabtp7q8lo23v54c0/family1/a40bb74c83d34be9b459af6ac592292e 2023-03-07 10:55:38,184 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230307 table='testCompactionWithHFileLink' column='family1' 2023-03-07 10:55:38,185 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:38,186 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303070e1333264a4544428affb3bb698cf9ab to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303070e1333264a4544428affb3bb698cf9ab 2023-03-07 10:55:38,187 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230307bbd158cb8f784e08b5c8039b606cfbf2 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230307bbd158cb8f784e08b5c8039b606cfbf2 2023-03-07 10:55:38,188 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230307cfa2cbd6fec74dd4953ec0c6f2ebd3ea to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230307cfa2cbd6fec74dd4953ec0c6f2ebd3ea 2023-03-07 10:55:38,189 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230307deb08ef0574b42f2b1f5b31f390ce34e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230307deb08ef0574b42f2b1f5b31f390ce34e 2023-03-07 10:55:38,189 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-07 10:55:38,189 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230307' 2023-03-07 10:55:38,190 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230307 for table='testCompactionWithHFileLink' and column='family1' 2023-03-07 10:55:38,515 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230307777dd9d2326d439386325ccfc7d70a01 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230307777dd9d2326d439386325ccfc7d70a01 2023-03-07 10:55:38,516 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230307 table='testCompactionWithHFileLink' column='family1' 2023-03-07 10:55:38,520 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023030736adf274f16b4d4aba9b90e04d69532e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023030736adf274f16b4d4aba9b90e04d69532e 2023-03-07 10:55:38,521 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230307 table='testCompactionWithHFileLink' column='family1' 2023-03-07 10:55:38,542 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230307/family1/15c2f3d47c784048b1f9d15a04b3c508 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-03-07 10:55:38,544 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=32 for row with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230307/family1/15c2f3d47c784048b1f9d15a04b3c508}] 2023-03-07 10:55:38,546 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230307/family1/15c2f3d47c784048b1f9d15a04b3c508 for inclusion in 0d21772dd37bba3b2c4b78b20a3c30e0/family1 2023-03-07 10:55:38,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-03-07 10:55:38,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(777): Region bounds: first= last=1 2023-03-07 10:55:38,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for 0d21772dd37bba3b2c4b78b20a3c30e0: 2023-03-07 10:55:38,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230307/family1/15c2f3d47c784048b1f9d15a04b3c508 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__9lb54o5gd91dtfeguik88scvrgobs7s4dgo22vhksucg8aiblpjphiuakvfianuv/family1/15c2f3d47c784048b1f9d15a04b3c508 2023-03-07 10:55:38,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__9lb54o5gd91dtfeguik88scvrgobs7s4dgo22vhksucg8aiblpjphiuakvfianuv/family1/15c2f3d47c784048b1f9d15a04b3c508 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/403184481cc54e459cf98a3865a81f48_SeqId_34_ 2023-03-07 10:55:38,552 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__9lb54o5gd91dtfeguik88scvrgobs7s4dgo22vhksucg8aiblpjphiuakvfianuv/family1/15c2f3d47c784048b1f9d15a04b3c508 into 0d21772dd37bba3b2c4b78b20a3c30e0/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/403184481cc54e459cf98a3865a81f48_SeqId_34_ - updating store file list. 2023-03-07 10:55:38,554 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230307/family1/f1efee7d7a91405eb5e4b4b67631c3c8 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-03-07 10:55:38,555 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230307/family1/f1efee7d7a91405eb5e4b4b67631c3c8}] 2023-03-07 10:55:38,557 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/403184481cc54e459cf98a3865a81f48_SeqId_34_ into 0d21772dd37bba3b2c4b78b20a3c30e0/family1 2023-03-07 10:55:38,557 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__9lb54o5gd91dtfeguik88scvrgobs7s4dgo22vhksucg8aiblpjphiuakvfianuv/family1/15c2f3d47c784048b1f9d15a04b3c508 into 0d21772dd37bba3b2c4b78b20a3c30e0/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/403184481cc54e459cf98a3865a81f48_SeqId_34_) 2023-03-07 10:55:38,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__9lb54o5gd91dtfeguik88scvrgobs7s4dgo22vhksucg8aiblpjphiuakvfianuv/family1/15c2f3d47c784048b1f9d15a04b3c508 2023-03-07 10:55:38,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230307/family1/f1efee7d7a91405eb5e4b4b67631c3c8 for inclusion in b443f7ebc46146a5bfe8850837317577/family1 2023-03-07 10:55:38,559 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230307 table='testCompactionWithHFileLink' column='family1' 2023-03-07 10:55:38,559 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:38,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-03-07 10:55:38,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-07 10:55:38,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for b443f7ebc46146a5bfe8850837317577: 2023-03-07 10:55:38,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230307/family1/f1efee7d7a91405eb5e4b4b67631c3c8 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__e8fl2g52l2n0o2qhd2nss1r3r7gjpgod68a3o9ejuo1k07qct1efciutum0s21fe/family1/f1efee7d7a91405eb5e4b4b67631c3c8 2023-03-07 10:55:38,562 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303072fbc14d87b0b4871bfaf045896222f60 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303072fbc14d87b0b4871bfaf045896222f60 2023-03-07 10:55:38,563 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303073736dae9f7044ad8aebf6ed5bd19ceb6 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303073736dae9f7044ad8aebf6ed5bd19ceb6 2023-03-07 10:55:38,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__e8fl2g52l2n0o2qhd2nss1r3r7gjpgod68a3o9ejuo1k07qct1efciutum0s21fe/family1/f1efee7d7a91405eb5e4b4b67631c3c8 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/ed36ebed67074b479c814446b2b3d397_SeqId_34_ 2023-03-07 10:55:38,564 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303074776994284e2411e9710ec77eb9e8c9c to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303074776994284e2411e9710ec77eb9e8c9c 2023-03-07 10:55:38,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__e8fl2g52l2n0o2qhd2nss1r3r7gjpgod68a3o9ejuo1k07qct1efciutum0s21fe/family1/f1efee7d7a91405eb5e4b4b67631c3c8 into b443f7ebc46146a5bfe8850837317577/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/ed36ebed67074b479c814446b2b3d397_SeqId_34_ - updating store file list. 2023-03-07 10:55:38,565 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303074b0e28029e684108addabacca2b732e9 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303074b0e28029e684108addabacca2b732e9 2023-03-07 10:55:38,565 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-07 10:55:38,565 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230307' 2023-03-07 10:55:38,565 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230307 for table='testCompactionWithHFileLink' and column='family1' 2023-03-07 10:55:38,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/ed36ebed67074b479c814446b2b3d397_SeqId_34_ into b443f7ebc46146a5bfe8850837317577/family1 2023-03-07 10:55:38,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__e8fl2g52l2n0o2qhd2nss1r3r7gjpgod68a3o9ejuo1k07qct1efciutum0s21fe/family1/f1efee7d7a91405eb5e4b4b67631c3c8 into b443f7ebc46146a5bfe8850837317577/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/ed36ebed67074b479c814446b2b3d397_SeqId_34_) 2023-03-07 10:55:38,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testCompactionWithHFileLink__e8fl2g52l2n0o2qhd2nss1r3r7gjpgod68a3o9ejuo1k07qct1efciutum0s21fe/family1/f1efee7d7a91405eb5e4b4b67631c3c8 2023-03-07 10:55:38,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-07 10:55:38,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-03-07 10:55:38,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(1912): b443f7ebc46146a5bfe8850837317577/family1 is initiating minor compaction (all files) 2023-03-07 10:55:38,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7254d836; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-03-07 10:55:38,571 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230307 table='testCompactionWithHFileLink' column='family1' 2023-03-07 10:55:38,572 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:38,573 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023030707c2b04bd0454afe9f5ffe106c854973 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023030707c2b04bd0454afe9f5ffe106c854973 2023-03-07 10:55:38,574 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230307113ba20ec7aa40c1a7dedda473e727ef to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230307113ba20ec7aa40c1a7dedda473e727ef 2023-03-07 10:55:38,575 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230307aa1c312cc47f4c8caf0cc3707f1027d4 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230307aa1c312cc47f4c8caf0cc3707f1027d4 2023-03-07 10:55:38,576 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230307faa4a20384264bcab422aee73cf4231b to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230307faa4a20384264bcab422aee73cf4231b 2023-03-07 10:55:38,576 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-07 10:55:38,576 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230307' 2023-03-07 10:55:38,577 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230307 for table='testCompactionWithHFileLink' and column='family1' 2023-03-07 10:55:38,577 INFO [Listener at localhost/42383] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-03-07 10:55:38,579 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-07 10:55:38,581 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-07 10:55:38,583 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-07 10:55:38,584 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-07 10:55:38,589 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-07 10:55:38,590 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-07 10:55:38,608 INFO [Listener at localhost/42383] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=282 (was 248) - Thread LEAK? -, OpenFileDescriptor=744 (was 616) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=158 (was 179), ProcessCount=171 (was 171), AvailableMemoryMB=9394 (was 9487) 2023-03-07 10:55:38,620 INFO [Listener at localhost/42383] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=282, OpenFileDescriptor=744, MaxFileDescriptor=60000, SystemLoadAverage=158, ProcessCount=171, AvailableMemoryMB=9393 2023-03-07 10:55:38,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-03-07 10:55:38,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-03-07 10:55:38,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-03-07 10:55:38,632 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-07 10:55:38,640 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 14 msec 2023-03-07 10:55:38,647 DEBUG [RS:0;jenkins-hbase4:39673-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/.tmp/family2/1beb6609307e47babe65628c79dae093 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/1beb6609307e47babe65628c79dae093 2023-03-07 10:55:38,650 INFO [RS:0;jenkins-hbase4:39673-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in f26513f1f71767bd16ace3f43fa52372/family2 of f26513f1f71767bd16ace3f43fa52372 into 1beb6609307e47babe65628c79dae093(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-07 10:55:38,650 DEBUG [RS:0;jenkins-hbase4:39673-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for f26513f1f71767bd16ace3f43fa52372: 2023-03-07 10:55:38,650 INFO [RS:0;jenkins-hbase4:39673-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372., storeName=f26513f1f71767bd16ace3f43fa52372/family2, priority=12, startTime=1678186537354; duration=1sec 2023-03-07 10:55:38,650 DEBUG [RS:0;jenkins-hbase4:39673-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-03-07 10:55:38,650 INFO [RS:0;jenkins-hbase4:39673-longCompactions-0] regionserver.HRegion(2259): Starting compaction of b443f7ebc46146a5bfe8850837317577/family1 in testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:38,650 INFO [RS:0;jenkins-hbase4:39673-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-cb481fb954494136b4a726a0ab103581, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-d21bb01241d24ac2b565a7adbdf4723e, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-9f3590c6a938489a8c6dee641c847d93, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-08f3422db7d44740879de03c5cf14cc5, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/ed36ebed67074b479c814446b2b3d397_SeqId_34_] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp, totalSize=28.9 K 2023-03-07 10:55:38,651 DEBUG [RS:0;jenkins-hbase4:39673-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-cb481fb954494136b4a726a0ab103581, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678186512664 2023-03-07 10:55:38,651 DEBUG [RS:0;jenkins-hbase4:39673-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-d21bb01241d24ac2b565a7adbdf4723e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678186514447 2023-03-07 10:55:38,652 DEBUG [RS:0;jenkins-hbase4:39673-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-9f3590c6a938489a8c6dee641c847d93, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678186516241 2023-03-07 10:55:38,652 DEBUG [RS:0;jenkins-hbase4:39673-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-08f3422db7d44740879de03c5cf14cc5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678186518050 2023-03-07 10:55:38,652 DEBUG [RS:0;jenkins-hbase4:39673-longCompactions-0] compactions.Compactor(207): Compacting ed36ebed67074b479c814446b2b3d397_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1678186512664 2023-03-07 10:55:38,665 INFO [RS:0;jenkins-hbase4:39673-longCompactions-0] throttle.PressureAwareThroughputController(145): b443f7ebc46146a5bfe8850837317577#family1#compaction#117 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-03-07 10:55:38,689 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-f70d3690b0f447b49db6d7eb03105784, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-fc1ba96d8b7d4bc88a13a242f8274347, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-b95dd1783dc8473da64b71a3509c87e9, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-1655730916ad4fd5b519579e7665c10a] to archive 2023-03-07 10:55:38,689 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:38,691 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-f70d3690b0f447b49db6d7eb03105784 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-f70d3690b0f447b49db6d7eb03105784 2023-03-07 10:55:38,692 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-fc1ba96d8b7d4bc88a13a242f8274347 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-fc1ba96d8b7d4bc88a13a242f8274347 2023-03-07 10:55:38,693 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-b95dd1783dc8473da64b71a3509c87e9 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-b95dd1783dc8473da64b71a3509c87e9 2023-03-07 10:55:38,694 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-1655730916ad4fd5b519579e7665c10a to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/family2/testCompactionWithHFileLink=f26513f1f71767bd16ace3f43fa52372-1655730916ad4fd5b519579e7665c10a 2023-03-07 10:55:38,725 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp/family1/df375642a5a346cc9d4c7a760bae9bf9 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/df375642a5a346cc9d4c7a760bae9bf9 2023-03-07 10:55:38,728 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 0d21772dd37bba3b2c4b78b20a3c30e0/family1 of 0d21772dd37bba3b2c4b78b20a3c30e0 into df375642a5a346cc9d4c7a760bae9bf9(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-07 10:55:38,728 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0d21772dd37bba3b2c4b78b20a3c30e0: 2023-03-07 10:55:38,728 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0., storeName=0d21772dd37bba3b2c4b78b20a3c30e0/family1, priority=12, startTime=1678186537462; duration=1sec 2023-03-07 10:55:38,729 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-07 10:55:38,729 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 5 compacting, 0 eligible, 16 blocking 2023-03-07 10:55:38,729 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-07 10:55:38,729 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-07 10:55:38,729 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. because compaction request was cancelled 2023-03-07 10:55:38,729 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-07 10:55:38,730 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-07 10:55:38,730 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1912): b443f7ebc46146a5bfe8850837317577/family2 is initiating minor compaction (all files) 2023-03-07 10:55:38,730 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b443f7ebc46146a5bfe8850837317577/family2 in testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:55:38,731 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-155cce75e6a1420499a693f041db2a8a, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-ddd7d6d0122b4ae4aa75ab21a617e772, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-ebb55b1118234afc9d6e873a5355090c, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-765bba2f4b744b85b2b6f28fbf7a3f6f] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp, totalSize=20.4 K 2023-03-07 10:55:38,731 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-155cce75e6a1420499a693f041db2a8a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678186512664 2023-03-07 10:55:38,731 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-ddd7d6d0122b4ae4aa75ab21a617e772, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678186514447 2023-03-07 10:55:38,732 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-ebb55b1118234afc9d6e873a5355090c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678186516241 2023-03-07 10:55:38,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-03-07 10:55:38,732 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-765bba2f4b744b85b2b6f28fbf7a3f6f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678186518050 2023-03-07 10:55:38,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-07 10:55:38,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-03-07 10:55:38,736 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-03-07 10:55:38,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-03-07 10:55:38,736 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-07 10:55:38,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-07 10:55:38,738 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d 2023-03-07 10:55:38,738 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2 2023-03-07 10:55:38,738 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c 2023-03-07 10:55:38,739 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d empty. 2023-03-07 10:55:38,739 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2 empty. 2023-03-07 10:55:38,739 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c empty. 2023-03-07 10:55:38,739 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d 2023-03-07 10:55:38,739 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c 2023-03-07 10:55:38,739 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2 2023-03-07 10:55:38,739 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-03-07 10:55:38,745 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] throttle.PressureAwareThroughputController(145): b443f7ebc46146a5bfe8850837317577#family2#compaction#118 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-03-07 10:55:38,782 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-385bfcef9cf24048be847a094f25a7ca, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-d8c20ccc995d4822aa0a6447ed64c0ba, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-ba05f2f176834c0295bd4c13661b2057, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-4d783e473cfd49c6a011ff93a846341e] to archive 2023-03-07 10:55:38,782 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:38,784 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-385bfcef9cf24048be847a094f25a7ca to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-385bfcef9cf24048be847a094f25a7ca 2023-03-07 10:55:38,785 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-d8c20ccc995d4822aa0a6447ed64c0ba to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-d8c20ccc995d4822aa0a6447ed64c0ba 2023-03-07 10:55:38,786 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-ba05f2f176834c0295bd4c13661b2057 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-ba05f2f176834c0295bd4c13661b2057 2023-03-07 10:55:38,787 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-4d783e473cfd49c6a011ff93a846341e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family1/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-4d783e473cfd49c6a011ff93a846341e 2023-03-07 10:55:38,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-07 10:55:39,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-07 10:55:39,147 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-03-07 10:55:39,148 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 53e5fe74e89a0e6cfd7117280e42010d, NAME => 'ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp 2023-03-07 10:55:39,148 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => a8da3ca5bc578b596af4858d20f27e6c, NAME => 'ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp 2023-03-07 10:55:39,149 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => a270310ad72fe35b8edc286783c8e2c2, NAME => 'ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp 2023-03-07 10:55:39,161 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:55:39,162 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing 53e5fe74e89a0e6cfd7117280e42010d, disabling compactions & flushes 2023-03-07 10:55:39,162 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. 2023-03-07 10:55:39,162 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. 2023-03-07 10:55:39,162 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. after waiting 0 ms 2023-03-07 10:55:39,162 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. 2023-03-07 10:55:39,162 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. 2023-03-07 10:55:39,162 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 53e5fe74e89a0e6cfd7117280e42010d: 2023-03-07 10:55:39,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-07 10:55:39,556 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:55:39,556 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing a270310ad72fe35b8edc286783c8e2c2, disabling compactions & flushes 2023-03-07 10:55:39,556 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. 2023-03-07 10:55:39,556 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. 2023-03-07 10:55:39,556 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. after waiting 0 ms 2023-03-07 10:55:39,556 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. 2023-03-07 10:55:39,556 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. 2023-03-07 10:55:39,556 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for a270310ad72fe35b8edc286783c8e2c2: 2023-03-07 10:55:39,556 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:55:39,557 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing a8da3ca5bc578b596af4858d20f27e6c, disabling compactions & flushes 2023-03-07 10:55:39,557 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. 2023-03-07 10:55:39,557 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. 2023-03-07 10:55:39,557 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. after waiting 0 ms 2023-03-07 10:55:39,557 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. 2023-03-07 10:55:39,557 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. 2023-03-07 10:55:39,557 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for a8da3ca5bc578b596af4858d20f27e6c: 2023-03-07 10:55:39,559 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-03-07 10:55:39,560 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678186539559"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186539559"}]},"ts":"1678186539559"} 2023-03-07 10:55:39,560 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1678186539559"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186539559"}]},"ts":"1678186539559"} 2023-03-07 10:55:39,560 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678186539559"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186539559"}]},"ts":"1678186539559"} 2023-03-07 10:55:39,561 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-07 10:55:39,562 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp/family2/98e75d0553c146a0b1cc1bdf61e36bea as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/98e75d0553c146a0b1cc1bdf61e36bea 2023-03-07 10:55:39,562 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-07 10:55:39,562 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186539562"}]},"ts":"1678186539562"} 2023-03-07 10:55:39,563 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-03-07 10:55:39,566 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in b443f7ebc46146a5bfe8850837317577/family2 of b443f7ebc46146a5bfe8850837317577 into 98e75d0553c146a0b1cc1bdf61e36bea(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-07 10:55:39,566 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b443f7ebc46146a5bfe8850837317577: 2023-03-07 10:55:39,566 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577., storeName=b443f7ebc46146a5bfe8850837317577/family2, priority=12, startTime=1678186537546; duration=0sec 2023-03-07 10:55:39,566 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-07 10:55:39,566 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-07 10:55:39,566 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=53e5fe74e89a0e6cfd7117280e42010d, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a270310ad72fe35b8edc286783c8e2c2, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a8da3ca5bc578b596af4858d20f27e6c, ASSIGN}] 2023-03-07 10:55:39,568 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=53e5fe74e89a0e6cfd7117280e42010d, ASSIGN 2023-03-07 10:55:39,568 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a270310ad72fe35b8edc286783c8e2c2, ASSIGN 2023-03-07 10:55:39,568 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a8da3ca5bc578b596af4858d20f27e6c, ASSIGN 2023-03-07 10:55:39,569 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=53e5fe74e89a0e6cfd7117280e42010d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39673,1678186416064; forceNewPlan=false, retain=false 2023-03-07 10:55:39,569 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a270310ad72fe35b8edc286783c8e2c2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39673,1678186416064; forceNewPlan=false, retain=false 2023-03-07 10:55:39,569 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a8da3ca5bc578b596af4858d20f27e6c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39673,1678186416064; forceNewPlan=false, retain=false 2023-03-07 10:55:39,570 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-07 10:55:39,570 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1912): 0d21772dd37bba3b2c4b78b20a3c30e0/family2 is initiating minor compaction (all files) 2023-03-07 10:55:39,570 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0d21772dd37bba3b2c4b78b20a3c30e0/family2 in testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:55:39,570 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-4a61a5e4bafc4924b54fb3680d1bf155, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-d4c9be19609b4018b7e188ac1153e94f, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-3f49ab0c8c2144ec9a92aa1f89b8c5f4, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-5d65e859364a4b6ab723f7c7a44d2a4b] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp, totalSize=20.4 K 2023-03-07 10:55:39,571 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-4a61a5e4bafc4924b54fb3680d1bf155, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678186512662 2023-03-07 10:55:39,571 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-d4c9be19609b4018b7e188ac1153e94f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678186514447 2023-03-07 10:55:39,572 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-3f49ab0c8c2144ec9a92aa1f89b8c5f4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678186516241 2023-03-07 10:55:39,572 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-5d65e859364a4b6ab723f7c7a44d2a4b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678186518049 2023-03-07 10:55:39,579 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-155cce75e6a1420499a693f041db2a8a, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-ddd7d6d0122b4ae4aa75ab21a617e772, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-ebb55b1118234afc9d6e873a5355090c, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-765bba2f4b744b85b2b6f28fbf7a3f6f] to archive 2023-03-07 10:55:39,580 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:39,581 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-155cce75e6a1420499a693f041db2a8a to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-155cce75e6a1420499a693f041db2a8a 2023-03-07 10:55:39,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-ddd7d6d0122b4ae4aa75ab21a617e772 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-ddd7d6d0122b4ae4aa75ab21a617e772 2023-03-07 10:55:39,582 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0d21772dd37bba3b2c4b78b20a3c30e0#family2#compaction#119 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-03-07 10:55:39,584 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-ebb55b1118234afc9d6e873a5355090c to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-ebb55b1118234afc9d6e873a5355090c 2023-03-07 10:55:39,585 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-765bba2f4b744b85b2b6f28fbf7a3f6f to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family2/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-765bba2f4b744b85b2b6f28fbf7a3f6f 2023-03-07 10:55:39,589 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-07 10:55:39,721 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=a8da3ca5bc578b596af4858d20f27e6c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:39,721 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=a270310ad72fe35b8edc286783c8e2c2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:39,721 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=53e5fe74e89a0e6cfd7117280e42010d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:39,722 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1678186539721"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186539721"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186539721"}]},"ts":"1678186539721"} 2023-03-07 10:55:39,722 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678186539721"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186539721"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186539721"}]},"ts":"1678186539721"} 2023-03-07 10:55:39,722 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678186539721"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186539721"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186539721"}]},"ts":"1678186539721"} 2023-03-07 10:55:39,723 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure a270310ad72fe35b8edc286783c8e2c2, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:55:39,724 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=106, state=RUNNABLE; OpenRegionProcedure 53e5fe74e89a0e6cfd7117280e42010d, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:55:39,724 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=108, state=RUNNABLE; OpenRegionProcedure a8da3ca5bc578b596af4858d20f27e6c, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:55:39,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-07 10:55:39,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. 2023-03-07 10:55:39,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a270310ad72fe35b8edc286783c8e2c2, NAME => 'ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2.', STARTKEY => '1', ENDKEY => '2'} 2023-03-07 10:55:39,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction a270310ad72fe35b8edc286783c8e2c2 2023-03-07 10:55:39,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:55:39,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a270310ad72fe35b8edc286783c8e2c2 2023-03-07 10:55:39,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a270310ad72fe35b8edc286783c8e2c2 2023-03-07 10:55:39,879 INFO [StoreOpener-a270310ad72fe35b8edc286783c8e2c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a270310ad72fe35b8edc286783c8e2c2 2023-03-07 10:55:39,880 DEBUG [StoreOpener-a270310ad72fe35b8edc286783c8e2c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1 2023-03-07 10:55:39,880 DEBUG [StoreOpener-a270310ad72fe35b8edc286783c8e2c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1 2023-03-07 10:55:39,881 INFO [StoreOpener-a270310ad72fe35b8edc286783c8e2c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a270310ad72fe35b8edc286783c8e2c2 columnFamilyName family1 2023-03-07 10:55:39,882 DEBUG [RS:0;jenkins-hbase4:39673-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/.tmp/family1/847cf12ad6714d8b962bea0f4c1642a6 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/847cf12ad6714d8b962bea0f4c1642a6 2023-03-07 10:55:39,882 INFO [StoreOpener-a270310ad72fe35b8edc286783c8e2c2-1] regionserver.HStore(310): Store=a270310ad72fe35b8edc286783c8e2c2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:55:39,882 INFO [StoreOpener-a270310ad72fe35b8edc286783c8e2c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region a270310ad72fe35b8edc286783c8e2c2 2023-03-07 10:55:39,884 DEBUG [StoreOpener-a270310ad72fe35b8edc286783c8e2c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2 2023-03-07 10:55:39,884 DEBUG [StoreOpener-a270310ad72fe35b8edc286783c8e2c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2 2023-03-07 10:55:39,884 INFO [StoreOpener-a270310ad72fe35b8edc286783c8e2c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a270310ad72fe35b8edc286783c8e2c2 columnFamilyName family2 2023-03-07 10:55:39,885 INFO [StoreOpener-a270310ad72fe35b8edc286783c8e2c2-1] regionserver.HStore(310): Store=a270310ad72fe35b8edc286783c8e2c2/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:55:39,886 INFO [RS:0;jenkins-hbase4:39673-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in b443f7ebc46146a5bfe8850837317577/family1 of b443f7ebc46146a5bfe8850837317577 into 847cf12ad6714d8b962bea0f4c1642a6(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-07 10:55:39,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2 2023-03-07 10:55:39,886 DEBUG [RS:0;jenkins-hbase4:39673-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for b443f7ebc46146a5bfe8850837317577: 2023-03-07 10:55:39,886 INFO [RS:0;jenkins-hbase4:39673-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1678186538569; duration=1sec 2023-03-07 10:55:39,886 DEBUG [RS:0;jenkins-hbase4:39673-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:55:39,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2 2023-03-07 10:55:39,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-07 10:55:39,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a270310ad72fe35b8edc286783c8e2c2 2023-03-07 10:55:39,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-07 10:55:39,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a270310ad72fe35b8edc286783c8e2c2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66099071, jitterRate=-0.015047088265419006}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-07 10:55:39,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a270310ad72fe35b8edc286783c8e2c2: 2023-03-07 10:55:39,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2., pid=109, masterSystemTime=1678186539875 2023-03-07 10:55:39,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. 2023-03-07 10:55:39,893 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. 2023-03-07 10:55:39,893 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. 2023-03-07 10:55:39,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a8da3ca5bc578b596af4858d20f27e6c, NAME => 'ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c.', STARTKEY => '2', ENDKEY => ''} 2023-03-07 10:55:39,893 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=a270310ad72fe35b8edc286783c8e2c2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:39,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction a8da3ca5bc578b596af4858d20f27e6c 2023-03-07 10:55:39,893 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1678186539893"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186539893"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186539893"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186539893"}]},"ts":"1678186539893"} 2023-03-07 10:55:39,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:55:39,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a8da3ca5bc578b596af4858d20f27e6c 2023-03-07 10:55:39,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a8da3ca5bc578b596af4858d20f27e6c 2023-03-07 10:55:39,895 INFO [StoreOpener-a8da3ca5bc578b596af4858d20f27e6c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a8da3ca5bc578b596af4858d20f27e6c 2023-03-07 10:55:39,896 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-03-07 10:55:39,896 DEBUG [StoreOpener-a8da3ca5bc578b596af4858d20f27e6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1 2023-03-07 10:55:39,896 DEBUG [StoreOpener-a8da3ca5bc578b596af4858d20f27e6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1 2023-03-07 10:55:39,896 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure a270310ad72fe35b8edc286783c8e2c2, server=jenkins-hbase4.apache.org,39673,1678186416064 in 172 msec 2023-03-07 10:55:39,896 INFO [StoreOpener-a8da3ca5bc578b596af4858d20f27e6c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a8da3ca5bc578b596af4858d20f27e6c columnFamilyName family1 2023-03-07 10:55:39,898 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a270310ad72fe35b8edc286783c8e2c2, ASSIGN in 330 msec 2023-03-07 10:55:39,898 INFO [StoreOpener-a8da3ca5bc578b596af4858d20f27e6c-1] regionserver.HStore(310): Store=a8da3ca5bc578b596af4858d20f27e6c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:55:39,898 INFO [StoreOpener-a8da3ca5bc578b596af4858d20f27e6c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region a8da3ca5bc578b596af4858d20f27e6c 2023-03-07 10:55:39,899 DEBUG [StoreOpener-a8da3ca5bc578b596af4858d20f27e6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2 2023-03-07 10:55:39,900 DEBUG [StoreOpener-a8da3ca5bc578b596af4858d20f27e6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2 2023-03-07 10:55:39,900 INFO [StoreOpener-a8da3ca5bc578b596af4858d20f27e6c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a8da3ca5bc578b596af4858d20f27e6c columnFamilyName family2 2023-03-07 10:55:39,901 INFO [StoreOpener-a8da3ca5bc578b596af4858d20f27e6c-1] regionserver.HStore(310): Store=a8da3ca5bc578b596af4858d20f27e6c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:55:39,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c 2023-03-07 10:55:39,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c 2023-03-07 10:55:39,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-07 10:55:39,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a8da3ca5bc578b596af4858d20f27e6c 2023-03-07 10:55:39,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-07 10:55:39,905 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a8da3ca5bc578b596af4858d20f27e6c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68887288, jitterRate=0.026500582695007324}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-07 10:55:39,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a8da3ca5bc578b596af4858d20f27e6c: 2023-03-07 10:55:39,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c., pid=111, masterSystemTime=1678186539875 2023-03-07 10:55:39,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. 2023-03-07 10:55:39,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. 2023-03-07 10:55:39,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. 2023-03-07 10:55:39,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 53e5fe74e89a0e6cfd7117280e42010d, NAME => 'ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d.', STARTKEY => '', ENDKEY => '1'} 2023-03-07 10:55:39,907 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=a8da3ca5bc578b596af4858d20f27e6c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:39,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 53e5fe74e89a0e6cfd7117280e42010d 2023-03-07 10:55:39,908 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678186539907"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186539907"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186539907"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186539907"}]},"ts":"1678186539907"} 2023-03-07 10:55:39,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:55:39,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 53e5fe74e89a0e6cfd7117280e42010d 2023-03-07 10:55:39,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 53e5fe74e89a0e6cfd7117280e42010d 2023-03-07 10:55:39,909 INFO [StoreOpener-53e5fe74e89a0e6cfd7117280e42010d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 53e5fe74e89a0e6cfd7117280e42010d 2023-03-07 10:55:39,910 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=108 2023-03-07 10:55:39,910 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=108, state=SUCCESS; OpenRegionProcedure a8da3ca5bc578b596af4858d20f27e6c, server=jenkins-hbase4.apache.org,39673,1678186416064 in 185 msec 2023-03-07 10:55:39,910 DEBUG [StoreOpener-53e5fe74e89a0e6cfd7117280e42010d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1 2023-03-07 10:55:39,910 DEBUG [StoreOpener-53e5fe74e89a0e6cfd7117280e42010d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1 2023-03-07 10:55:39,911 INFO [StoreOpener-53e5fe74e89a0e6cfd7117280e42010d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 53e5fe74e89a0e6cfd7117280e42010d columnFamilyName family1 2023-03-07 10:55:39,911 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a8da3ca5bc578b596af4858d20f27e6c, ASSIGN in 344 msec 2023-03-07 10:55:39,911 INFO [StoreOpener-53e5fe74e89a0e6cfd7117280e42010d-1] regionserver.HStore(310): Store=53e5fe74e89a0e6cfd7117280e42010d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:55:39,912 INFO [StoreOpener-53e5fe74e89a0e6cfd7117280e42010d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 53e5fe74e89a0e6cfd7117280e42010d 2023-03-07 10:55:39,913 DEBUG [StoreOpener-53e5fe74e89a0e6cfd7117280e42010d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2 2023-03-07 10:55:39,913 DEBUG [StoreOpener-53e5fe74e89a0e6cfd7117280e42010d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2 2023-03-07 10:55:39,913 INFO [StoreOpener-53e5fe74e89a0e6cfd7117280e42010d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 53e5fe74e89a0e6cfd7117280e42010d columnFamilyName family2 2023-03-07 10:55:39,914 INFO [StoreOpener-53e5fe74e89a0e6cfd7117280e42010d-1] regionserver.HStore(310): Store=53e5fe74e89a0e6cfd7117280e42010d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:55:39,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d 2023-03-07 10:55:39,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d 2023-03-07 10:55:39,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-07 10:55:39,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 53e5fe74e89a0e6cfd7117280e42010d 2023-03-07 10:55:39,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-07 10:55:39,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 53e5fe74e89a0e6cfd7117280e42010d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68540293, jitterRate=0.021329954266548157}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-07 10:55:39,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 53e5fe74e89a0e6cfd7117280e42010d: 2023-03-07 10:55:39,921 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d., pid=110, masterSystemTime=1678186539875 2023-03-07 10:55:39,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. 2023-03-07 10:55:39,922 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. 2023-03-07 10:55:39,922 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=53e5fe74e89a0e6cfd7117280e42010d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:39,922 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678186539922"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186539922"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186539922"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186539922"}]},"ts":"1678186539922"} 2023-03-07 10:55:39,925 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=106 2023-03-07 10:55:39,925 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=106, state=SUCCESS; OpenRegionProcedure 53e5fe74e89a0e6cfd7117280e42010d, server=jenkins-hbase4.apache.org,39673,1678186416064 in 200 msec 2023-03-07 10:55:39,926 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-03-07 10:55:39,926 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=53e5fe74e89a0e6cfd7117280e42010d, ASSIGN in 359 msec 2023-03-07 10:55:39,927 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-07 10:55:39,927 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186539927"}]},"ts":"1678186539927"} 2023-03-07 10:55:39,928 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-03-07 10:55:39,930 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-03-07 10:55:39,931 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.1960 sec 2023-03-07 10:55:39,980 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-cb481fb954494136b4a726a0ab103581, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-d21bb01241d24ac2b565a7adbdf4723e, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-9f3590c6a938489a8c6dee641c847d93, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-08f3422db7d44740879de03c5cf14cc5, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/ed36ebed67074b479c814446b2b3d397_SeqId_34_] to archive 2023-03-07 10:55:39,981 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:39,983 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-cb481fb954494136b4a726a0ab103581 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-cb481fb954494136b4a726a0ab103581 2023-03-07 10:55:39,984 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-d21bb01241d24ac2b565a7adbdf4723e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-d21bb01241d24ac2b565a7adbdf4723e 2023-03-07 10:55:39,985 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-9f3590c6a938489a8c6dee641c847d93 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-9f3590c6a938489a8c6dee641c847d93 2023-03-07 10:55:39,986 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-08f3422db7d44740879de03c5cf14cc5 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/testCompactionWithHFileLink=b443f7ebc46146a5bfe8850837317577-08f3422db7d44740879de03c5cf14cc5 2023-03-07 10:55:39,987 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/ed36ebed67074b479c814446b2b3d397_SeqId_34_ to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/family1/ed36ebed67074b479c814446b2b3d397_SeqId_34_ 2023-03-07 10:55:40,399 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/.tmp/family2/b5fbf3950da8446e8b5e42a2bc497cca as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/b5fbf3950da8446e8b5e42a2bc497cca 2023-03-07 10:55:40,403 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 0d21772dd37bba3b2c4b78b20a3c30e0/family2 of 0d21772dd37bba3b2c4b78b20a3c30e0 into b5fbf3950da8446e8b5e42a2bc497cca(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-07 10:55:40,403 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0d21772dd37bba3b2c4b78b20a3c30e0: 2023-03-07 10:55:40,403 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0., storeName=0d21772dd37bba3b2c4b78b20a3c30e0/family2, priority=12, startTime=1678186537463; duration=0sec 2023-03-07 10:55:40,403 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:55:40,484 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-4a61a5e4bafc4924b54fb3680d1bf155, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-d4c9be19609b4018b7e188ac1153e94f, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-3f49ab0c8c2144ec9a92aa1f89b8c5f4, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-5d65e859364a4b6ab723f7c7a44d2a4b] to archive 2023-03-07 10:55:40,485 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:40,486 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-4a61a5e4bafc4924b54fb3680d1bf155 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-4a61a5e4bafc4924b54fb3680d1bf155 2023-03-07 10:55:40,487 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-d4c9be19609b4018b7e188ac1153e94f to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-d4c9be19609b4018b7e188ac1153e94f 2023-03-07 10:55:40,488 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-3f49ab0c8c2144ec9a92aa1f89b8c5f4 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-3f49ab0c8c2144ec9a92aa1f89b8c5f4 2023-03-07 10:55:40,489 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-5d65e859364a4b6ab723f7c7a44d2a4b to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/family2/testCompactionWithHFileLink=0d21772dd37bba3b2c4b78b20a3c30e0-5d65e859364a4b6ab723f7c7a44d2a4b 2023-03-07 10:55:40,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-07 10:55:40,842 INFO [Listener at localhost/42383] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-03-07 10:55:40,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:55:40,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:55:40,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:55:40,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:55:40,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-07 10:55:40,852 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-07 10:55:40,852 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:55:40,852 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-07 10:55:40,852 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-07 10:55:40,852 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:40,852 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-07 10:55:40,854 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:40,854 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:55:40,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:55:40,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:55:40,854 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:40,855 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:55:40,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-07 10:55:40,855 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:40,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:55:40,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-07 10:55:40,855 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-07 10:55:40,855 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-07 10:55:40,855 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-07 10:55:40,855 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:55:40,856 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-07 10:55:40,856 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. 2023-03-07 10:55:40,856 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. started... 2023-03-07 10:55:40,856 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-07 10:55:40,856 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:55:40,858 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a8da3ca5bc578b596af4858d20f27e6c 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-07 10:55:40,857 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. 2023-03-07 10:55:40,857 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. 2023-03-07 10:55:40,858 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. started... 2023-03-07 10:55:40,858 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. started... 2023-03-07 10:55:40,858 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 53e5fe74e89a0e6cfd7117280e42010d 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-07 10:55:40,858 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a270310ad72fe35b8edc286783c8e2c2 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-07 10:55:41,274 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303077b292a0524cf48a8952d2fd4f4f1f8ee to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303077b292a0524cf48a8952d2fd4f4f1f8ee 2023-03-07 10:55:41,274 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230307d03693be120c4af0b921d0460b2fa746 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230307d03693be120c4af0b921d0460b2fa746 2023-03-07 10:55:41,274 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230307c53bb609ed794f9486ebb5c49d943e2b to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230307c53bb609ed794f9486ebb5c49d943e2b 2023-03-07 10:55:41,279 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/.tmp/family1/22189b6690c04552af0ee88c996a67ee 2023-03-07 10:55:41,680 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/.tmp/family1/42d7983cac524fe08ecb104cd3569e33 2023-03-07 10:55:41,680 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/.tmp/family1/07431787ee03449b8b6fe36529692675 2023-03-07 10:55:41,702 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230307b2ab0915bd184ef6bc649c323bfd7273 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230307b2ab0915bd184ef6bc649c323bfd7273 2023-03-07 10:55:42,101 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303071c3b9161ad5e4abf8392bef850d80711 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202303071c3b9161ad5e4abf8392bef850d80711 2023-03-07 10:55:42,105 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303078000400e16224dcb9e27467e692a2d65 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202303078000400e16224dcb9e27467e692a2d65 2023-03-07 10:55:42,108 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/.tmp/family2/7199dc1167224d30aff4cabce4bcdbbd 2023-03-07 10:55:42,109 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/.tmp/family2/f3664a8332d9477e975137dfffada2d2 2023-03-07 10:55:42,113 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/.tmp/family1/22189b6690c04552af0ee88c996a67ee as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/22189b6690c04552af0ee88c996a67ee 2023-03-07 10:55:42,116 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/.tmp/family1/07431787ee03449b8b6fe36529692675 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/07431787ee03449b8b6fe36529692675 2023-03-07 10:55:42,117 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/22189b6690c04552af0ee88c996a67ee, entries=4, sequenceid=5, filesize=5.4 K 2023-03-07 10:55:42,118 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/.tmp/family2/7199dc1167224d30aff4cabce4bcdbbd as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/7199dc1167224d30aff4cabce4bcdbbd 2023-03-07 10:55:42,120 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/07431787ee03449b8b6fe36529692675, entries=4, sequenceid=5, filesize=5.4 K 2023-03-07 10:55:42,121 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/.tmp/family2/f3664a8332d9477e975137dfffada2d2 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/f3664a8332d9477e975137dfffada2d2 2023-03-07 10:55:42,122 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/7199dc1167224d30aff4cabce4bcdbbd, entries=2, sequenceid=5, filesize=5.1 K 2023-03-07 10:55:42,123 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for a270310ad72fe35b8edc286783c8e2c2 in 1265ms, sequenceid=5, compaction requested=false 2023-03-07 10:55:42,123 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-03-07 10:55:42,124 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a270310ad72fe35b8edc286783c8e2c2: 2023-03-07 10:55:42,124 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. 2023-03-07 10:55:42,124 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-07 10:55:42,125 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/f3664a8332d9477e975137dfffada2d2, entries=2, sequenceid=5, filesize=5.1 K 2023-03-07 10:55:42,126 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 53e5fe74e89a0e6cfd7117280e42010d in 1268ms, sequenceid=5, compaction requested=false 2023-03-07 10:55:42,127 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 53e5fe74e89a0e6cfd7117280e42010d: 2023-03-07 10:55:42,127 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. 2023-03-07 10:55:42,127 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-07 10:55:42,511 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/.tmp/family2/bbb32dfe0ae54a1cb5c274879ad66688 2023-03-07 10:55:42,516 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/.tmp/family1/42d7983cac524fe08ecb104cd3569e33 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/42d7983cac524fe08ecb104cd3569e33 2023-03-07 10:55:42,519 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/42d7983cac524fe08ecb104cd3569e33, entries=4, sequenceid=5, filesize=5.4 K 2023-03-07 10:55:42,519 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/.tmp/family2/bbb32dfe0ae54a1cb5c274879ad66688 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/bbb32dfe0ae54a1cb5c274879ad66688 2023-03-07 10:55:42,522 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/bbb32dfe0ae54a1cb5c274879ad66688, entries=2, sequenceid=5, filesize=5.1 K 2023-03-07 10:55:42,523 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for a8da3ca5bc578b596af4858d20f27e6c in 1666ms, sequenceid=5, compaction requested=false 2023-03-07 10:55:42,523 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a8da3ca5bc578b596af4858d20f27e6c: 2023-03-07 10:55:42,523 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. 2023-03-07 10:55:42,523 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-07 10:55:42,523 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-07 10:55:42,523 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:42,523 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-07 10:55:42,523 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-07 10:55:42,526 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:42,526 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:42,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:42,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:42,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:42,527 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:42,527 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:55:42,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:42,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:42,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:42,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:42,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:42,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-07 10:55:42,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@af840d[Count = 0] remaining members to acquire global barrier 2023-03-07 10:55:42,528 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-07 10:55:42,528 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:42,529 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:42,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:42,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:42,529 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-07 10:55:42,529 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-07 10:55:42,529 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:55:42,530 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:42,530 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:55:42,531 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-07 10:55:42,531 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:42,531 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:55:42,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:42,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:42,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:42,531 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-07 10:55:42,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:42,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:42,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:42,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:42,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:42,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:42,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:42,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:55:42,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-07 10:55:42,533 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-07 10:55:42,533 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:55:42,533 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:55:42,533 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-07 10:55:42,533 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:55:42,534 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:42,534 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:42,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:42,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:42,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:42,534 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:55:42,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:42,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:42,535 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:42,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:55:42,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:55:42,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:42,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:42,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:42,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:42,536 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:42,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:42,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:42,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:42,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:42,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:42,539 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:42,539 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:55:42,539 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:55:42,539 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-07 10:55:42,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:55:42,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:55:42,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-07 10:55:42,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:55:42,539 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:55:42,539 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-07 10:55:42,539 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:42,539 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:42,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:55:42,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:55:42,539 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:42,540 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-07 10:55:42,540 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:42,540 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-07 10:55:42,540 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:55:42,640 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:55:42,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:55:42,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:55:42,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:55:42,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:55:42,644 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:55:42,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-07 10:55:42,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-07 10:55:42,646 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-07 10:55:42,646 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:55:42,646 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-07 10:55:42,646 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-07 10:55:42,646 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:42,646 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-07 10:55:42,648 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:42,648 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:55:42,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:55:42,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:55:42,648 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:42,648 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:55:42,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-07 10:55:42,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:42,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:55:42,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-07 10:55:42,649 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-07 10:55:42,649 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-07 10:55:42,649 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-07 10:55:42,649 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-07 10:55:42,649 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:55:42,649 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-07 10:55:42,649 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. 2023-03-07 10:55:42,650 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. started... 2023-03-07 10:55:42,650 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. 2023-03-07 10:55:42,650 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. started... 2023-03-07 10:55:42,650 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a8da3ca5bc578b596af4858d20f27e6c 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-07 10:55:42,650 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a270310ad72fe35b8edc286783c8e2c2 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-07 10:55:42,650 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-07 10:55:42,650 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:55:42,650 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. 2023-03-07 10:55:42,650 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. started... 2023-03-07 10:55:42,650 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 53e5fe74e89a0e6cfd7117280e42010d 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-07 10:55:42,670 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303071336c7ddf3304c96baaafae8aa193426 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303071336c7ddf3304c96baaafae8aa193426 2023-03-07 10:55:42,674 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/.tmp/family1/36719abc05c1475894f9ab9064b99a82 2023-03-07 10:55:43,065 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023030734fc58cbd90246608ada4725ecba7ce6 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023030734fc58cbd90246608ada4725ecba7ce6 2023-03-07 10:55:43,066 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023030709e2f12f13cf46abb12ae6eded1738bc to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023030709e2f12f13cf46abb12ae6eded1738bc 2023-03-07 10:55:43,086 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230307ce402aa1b33044ab997e44c3a4fad279 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230307ce402aa1b33044ab997e44c3a4fad279 2023-03-07 10:55:43,470 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/.tmp/family1/63c338af3fe44521bc45b19baae689b2 2023-03-07 10:55:43,470 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/.tmp/family1/e70c8db48f98440e9281fa5803e7433b 2023-03-07 10:55:43,483 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230307fa135ac9a4ad40368ecf9ae5d937ddd8 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230307fa135ac9a4ad40368ecf9ae5d937ddd8 2023-03-07 10:55:43,490 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/.tmp/family2/6a850968a188490bb85a0264fc34e19d 2023-03-07 10:55:43,494 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/.tmp/family1/36719abc05c1475894f9ab9064b99a82 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/36719abc05c1475894f9ab9064b99a82 2023-03-07 10:55:43,498 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/36719abc05c1475894f9ab9064b99a82, entries=4, sequenceid=9, filesize=5.4 K 2023-03-07 10:55:43,499 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/.tmp/family2/6a850968a188490bb85a0264fc34e19d as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/6a850968a188490bb85a0264fc34e19d 2023-03-07 10:55:43,503 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/6a850968a188490bb85a0264fc34e19d, entries=2, sequenceid=9, filesize=5.1 K 2023-03-07 10:55:43,503 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for a8da3ca5bc578b596af4858d20f27e6c in 853ms, sequenceid=9, compaction requested=false 2023-03-07 10:55:43,504 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a8da3ca5bc578b596af4858d20f27e6c: 2023-03-07 10:55:43,504 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. 2023-03-07 10:55:43,504 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-07 10:55:43,884 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303074e32aa481e0448c0a544f08d80646cfd to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202303074e32aa481e0448c0a544f08d80646cfd 2023-03-07 10:55:43,887 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/.tmp/family2/3cc2d761a018465489a1370ef5512401 2023-03-07 10:55:43,891 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/.tmp/family1/e70c8db48f98440e9281fa5803e7433b as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/e70c8db48f98440e9281fa5803e7433b 2023-03-07 10:55:43,894 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/e70c8db48f98440e9281fa5803e7433b, entries=4, sequenceid=9, filesize=5.4 K 2023-03-07 10:55:43,894 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/.tmp/family2/3cc2d761a018465489a1370ef5512401 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/3cc2d761a018465489a1370ef5512401 2023-03-07 10:55:43,897 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/3cc2d761a018465489a1370ef5512401, entries=2, sequenceid=9, filesize=5.1 K 2023-03-07 10:55:43,898 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 53e5fe74e89a0e6cfd7117280e42010d in 1248ms, sequenceid=9, compaction requested=false 2023-03-07 10:55:43,898 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 53e5fe74e89a0e6cfd7117280e42010d: 2023-03-07 10:55:43,898 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. 2023-03-07 10:55:43,898 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-07 10:55:44,289 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/.tmp/family2/0b44be6b4c1b4cbc8ab8d5a7db02383f 2023-03-07 10:55:44,294 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/.tmp/family1/63c338af3fe44521bc45b19baae689b2 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/63c338af3fe44521bc45b19baae689b2 2023-03-07 10:55:44,297 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/63c338af3fe44521bc45b19baae689b2, entries=4, sequenceid=9, filesize=5.4 K 2023-03-07 10:55:44,298 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/.tmp/family2/0b44be6b4c1b4cbc8ab8d5a7db02383f as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/0b44be6b4c1b4cbc8ab8d5a7db02383f 2023-03-07 10:55:44,301 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/0b44be6b4c1b4cbc8ab8d5a7db02383f, entries=2, sequenceid=9, filesize=5.1 K 2023-03-07 10:55:44,302 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for a270310ad72fe35b8edc286783c8e2c2 in 1652ms, sequenceid=9, compaction requested=false 2023-03-07 10:55:44,302 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a270310ad72fe35b8edc286783c8e2c2: 2023-03-07 10:55:44,302 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. 2023-03-07 10:55:44,302 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-07 10:55:44,302 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-07 10:55:44,302 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:44,302 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-07 10:55:44,302 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-07 10:55:44,304 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:44,304 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:44,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:44,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:44,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:44,304 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:44,304 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:55:44,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:44,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:44,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:44,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:44,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:44,306 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-07 10:55:44,306 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7943d1cd[Count = 0] remaining members to acquire global barrier 2023-03-07 10:55:44,306 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-07 10:55:44,306 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:44,307 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:44,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:44,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:44,307 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-07 10:55:44,307 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-07 10:55:44,307 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:44,307 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:55:44,307 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:55:44,312 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:44,312 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-07 10:55:44,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:44,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:44,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:44,312 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:55:44,313 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-07 10:55:44,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:44,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:44,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:44,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:44,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:44,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:44,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:44,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:55:44,315 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-07 10:55:44,315 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-07 10:55:44,315 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:55:44,315 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:55:44,315 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-07 10:55:44,315 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:55:44,316 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:44,317 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:44,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:44,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:44,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:44,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:44,317 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:55:44,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:44,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:44,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:55:44,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:55:44,317 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:44,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:44,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:44,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:44,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:44,318 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:44,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:44,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:44,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:44,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:44,320 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:55:44,320 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:44,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:55:44,321 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:55:44,320 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:55:44,321 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-07 10:55:44,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:55:44,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-07 10:55:44,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:55:44,321 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-07 10:55:44,321 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-07 10:55:44,321 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:44,321 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:44,321 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:44,321 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:44,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:55:44,321 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-07 10:55:44,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:55:44,321 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:55:44,421 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:55:44,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:55:44,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:55:44,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:55:44,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:55:44,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:55:44,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-07 10:55:44,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-07 10:55:44,428 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-07 10:55:44,428 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:55:44,428 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-07 10:55:44,428 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-07 10:55:44,428 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:44,428 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-07 10:55:44,429 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:55:44,429 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:44,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:55:44,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:55:44,430 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:44,430 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:55:44,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-07 10:55:44,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:44,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:55:44,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-07 10:55:44,430 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-07 10:55:44,431 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-07 10:55:44,431 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-07 10:55:44,431 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-07 10:55:44,431 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:55:44,431 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-07 10:55:44,431 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. 2023-03-07 10:55:44,431 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. started... 2023-03-07 10:55:44,431 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. 2023-03-07 10:55:44,431 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. 2023-03-07 10:55:44,431 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-07 10:55:44,431 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:55:44,431 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a8da3ca5bc578b596af4858d20f27e6c 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-07 10:55:44,431 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. started... 2023-03-07 10:55:44,431 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. started... 2023-03-07 10:55:44,431 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 53e5fe74e89a0e6cfd7117280e42010d 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-07 10:55:44,431 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a270310ad72fe35b8edc286783c8e2c2 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-07 10:55:44,444 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230307052d0acaac7c464e82afdd32e0f4a5ae to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230307052d0acaac7c464e82afdd32e0f4a5ae 2023-03-07 10:55:44,845 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230307e5038f40dc8a41c6b33132e03de4335d to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230307e5038f40dc8a41c6b33132e03de4335d 2023-03-07 10:55:44,846 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303073feaf6dc6450417d9a9c7a47686e2b8e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303073feaf6dc6450417d9a9c7a47686e2b8e 2023-03-07 10:55:44,848 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/.tmp/family1/2fc9b56c01744b1297289aaec80cb292 2023-03-07 10:55:45,250 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/.tmp/family1/e8cbe8a8a11f410b85d0c7b70192315f 2023-03-07 10:55:45,251 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/.tmp/family1/268e3978eb884d98a8dd6ddceb6fbe99 2023-03-07 10:55:45,262 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230307807fa83a4da24c9d9874567b98d6d087 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230307807fa83a4da24c9d9874567b98d6d087 2023-03-07 10:55:45,379 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-07 10:55:45,665 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023030756c9313383144ecc92635eca2b20e997 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023030756c9313383144ecc92635eca2b20e997 2023-03-07 10:55:45,666 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023030720642bba4fd644ddae060cf514715c5e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023030720642bba4fd644ddae060cf514715c5e 2023-03-07 10:55:45,669 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/.tmp/family2/5603504f3a264d68b523c112c82a6312 2023-03-07 10:55:45,671 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/.tmp/family2/749c1617d8ab4a34b80c21980e1feb18 2023-03-07 10:55:45,673 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/.tmp/family1/2fc9b56c01744b1297289aaec80cb292 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/2fc9b56c01744b1297289aaec80cb292 2023-03-07 10:55:45,674 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/.tmp/family1/268e3978eb884d98a8dd6ddceb6fbe99 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/268e3978eb884d98a8dd6ddceb6fbe99 2023-03-07 10:55:45,677 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/2fc9b56c01744b1297289aaec80cb292, entries=4, sequenceid=13, filesize=5.4 K 2023-03-07 10:55:45,678 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/268e3978eb884d98a8dd6ddceb6fbe99, entries=4, sequenceid=13, filesize=5.4 K 2023-03-07 10:55:45,678 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/.tmp/family2/5603504f3a264d68b523c112c82a6312 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/5603504f3a264d68b523c112c82a6312 2023-03-07 10:55:45,678 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/.tmp/family2/749c1617d8ab4a34b80c21980e1feb18 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/749c1617d8ab4a34b80c21980e1feb18 2023-03-07 10:55:45,681 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/5603504f3a264d68b523c112c82a6312, entries=2, sequenceid=13, filesize=5.1 K 2023-03-07 10:55:45,681 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/749c1617d8ab4a34b80c21980e1feb18, entries=2, sequenceid=13, filesize=5.1 K 2023-03-07 10:55:45,682 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for a270310ad72fe35b8edc286783c8e2c2 in 1251ms, sequenceid=13, compaction requested=true 2023-03-07 10:55:45,682 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a270310ad72fe35b8edc286783c8e2c2: 2023-03-07 10:55:45,682 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. 2023-03-07 10:55:45,682 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 53e5fe74e89a0e6cfd7117280e42010d in 1251ms, sequenceid=13, compaction requested=true 2023-03-07 10:55:45,682 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-07 10:55:45,682 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 53e5fe74e89a0e6cfd7117280e42010d: 2023-03-07 10:55:45,682 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. 2023-03-07 10:55:45,682 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-07 10:55:46,071 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/.tmp/family2/860847f6a836489bbeb072cc9187df91 2023-03-07 10:55:46,076 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/.tmp/family1/e8cbe8a8a11f410b85d0c7b70192315f as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/e8cbe8a8a11f410b85d0c7b70192315f 2023-03-07 10:55:46,079 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/e8cbe8a8a11f410b85d0c7b70192315f, entries=4, sequenceid=13, filesize=5.4 K 2023-03-07 10:55:46,079 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/.tmp/family2/860847f6a836489bbeb072cc9187df91 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/860847f6a836489bbeb072cc9187df91 2023-03-07 10:55:46,082 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/860847f6a836489bbeb072cc9187df91, entries=2, sequenceid=13, filesize=5.1 K 2023-03-07 10:55:46,083 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for a8da3ca5bc578b596af4858d20f27e6c in 1652ms, sequenceid=13, compaction requested=true 2023-03-07 10:55:46,083 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a8da3ca5bc578b596af4858d20f27e6c: 2023-03-07 10:55:46,083 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. 2023-03-07 10:55:46,083 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-07 10:55:46,083 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-07 10:55:46,083 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:46,083 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-07 10:55:46,083 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-07 10:55:46,086 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:46,086 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:46,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:46,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:46,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:46,086 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:46,086 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:55:46,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:46,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:46,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:46,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:46,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:46,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-07 10:55:46,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b22a842[Count = 0] remaining members to acquire global barrier 2023-03-07 10:55:46,087 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-07 10:55:46,087 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:46,089 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:46,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:46,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:46,089 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-07 10:55:46,089 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-07 10:55:46,089 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:55:46,089 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:46,089 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:55:46,090 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-07 10:55:46,090 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:46,090 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:55:46,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:46,090 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-07 10:55:46,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:46,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:46,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:46,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:46,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:46,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:46,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:46,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:46,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:46,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:55:46,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-07 10:55:46,092 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-07 10:55:46,092 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:55:46,092 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:55:46,092 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-07 10:55:46,092 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:55:46,093 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:46,093 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:46,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:46,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:46,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:46,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:46,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:46,094 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:55:46,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:55:46,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:55:46,094 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:46,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:46,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:46,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:46,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:46,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:46,095 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:46,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:46,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:46,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:46,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:46,098 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:46,098 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-07 10:55:46,098 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-07 10:55:46,098 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:55:46,098 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:55:46,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:55:46,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-07 10:55:46,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:55:46,098 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:55:46,098 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:46,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:55:46,098 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:46,098 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:46,098 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:46,098 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-07 10:55:46,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:55:46,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:55:46,099 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:55:46,199 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:55:46,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:55:46,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:55:46,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:55:46,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:55:46,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:55:46,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-07 10:55:46,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-07 10:55:46,205 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-07 10:55:46,205 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:55:46,205 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-07 10:55:46,205 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-07 10:55:46,206 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:46,206 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-07 10:55:46,207 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:46,207 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:55:46,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:55:46,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:55:46,207 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:46,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-07 10:55:46,207 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:55:46,208 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:46,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:55:46,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-07 10:55:46,208 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-07 10:55:46,208 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-07 10:55:46,208 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-07 10:55:46,208 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-07 10:55:46,208 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:55:46,208 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-07 10:55:46,209 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. 2023-03-07 10:55:46,209 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. started... 2023-03-07 10:55:46,209 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a8da3ca5bc578b596af4858d20f27e6c 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-07 10:55:46,212 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. 2023-03-07 10:55:46,212 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-07 10:55:46,212 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. 2023-03-07 10:55:46,212 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:55:46,212 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. started... 2023-03-07 10:55:46,212 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. started... 2023-03-07 10:55:46,212 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a270310ad72fe35b8edc286783c8e2c2 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-07 10:55:46,212 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 53e5fe74e89a0e6cfd7117280e42010d 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-07 10:55:46,232 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230307f586786eb3ec4d3ea18a61ba4e620018 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230307f586786eb3ec4d3ea18a61ba4e620018 2023-03-07 10:55:46,628 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230307b650c210d8794d74a6572de77673bee4 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230307b650c210d8794d74a6572de77673bee4 2023-03-07 10:55:46,629 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303074e1d98a43f8c49c0a83927230e02a8a3 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303074e1d98a43f8c49c0a83927230e02a8a3 2023-03-07 10:55:46,633 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/.tmp/family1/694299ef14e84b2eb2aba3d1f16d7c20 2023-03-07 10:55:46,636 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/.tmp/family1/b801be77fec44a10bf6e34390a50e8cb 2023-03-07 10:55:46,646 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230307f50b1d8d1c274203a84678c630445385 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230307f50b1d8d1c274203a84678c630445385 2023-03-07 10:55:46,653 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/.tmp/family2/def42fda7d4f4d0ebb73479f126aa211 2023-03-07 10:55:46,656 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/.tmp/family1/694299ef14e84b2eb2aba3d1f16d7c20 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/694299ef14e84b2eb2aba3d1f16d7c20 2023-03-07 10:55:46,659 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/694299ef14e84b2eb2aba3d1f16d7c20, entries=4, sequenceid=17, filesize=5.4 K 2023-03-07 10:55:46,660 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/.tmp/family2/def42fda7d4f4d0ebb73479f126aa211 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/def42fda7d4f4d0ebb73479f126aa211 2023-03-07 10:55:46,662 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/def42fda7d4f4d0ebb73479f126aa211, entries=2, sequenceid=17, filesize=5.1 K 2023-03-07 10:55:46,663 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 53e5fe74e89a0e6cfd7117280e42010d in 451ms, sequenceid=17, compaction requested=true 2023-03-07 10:55:46,663 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 53e5fe74e89a0e6cfd7117280e42010d: 2023-03-07 10:55:46,663 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. 2023-03-07 10:55:46,663 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-07 10:55:47,033 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/.tmp/family1/3c83d8cabeb746d2a4a962bff69d9b48 2023-03-07 10:55:47,057 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230307d73bd84369e34c40ba62298748033183 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230307d73bd84369e34c40ba62298748033183 2023-03-07 10:55:47,446 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230307096166b324fc4f5eb14e1985099c6fd6 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230307096166b324fc4f5eb14e1985099c6fd6 2023-03-07 10:55:47,461 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/.tmp/family2/b45bfda64da1490d9a3e5a36c39187ae 2023-03-07 10:55:47,464 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/.tmp/family1/b801be77fec44a10bf6e34390a50e8cb as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/b801be77fec44a10bf6e34390a50e8cb 2023-03-07 10:55:47,467 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/b801be77fec44a10bf6e34390a50e8cb, entries=4, sequenceid=17, filesize=5.4 K 2023-03-07 10:55:47,468 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/.tmp/family2/b45bfda64da1490d9a3e5a36c39187ae as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/b45bfda64da1490d9a3e5a36c39187ae 2023-03-07 10:55:47,471 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/b45bfda64da1490d9a3e5a36c39187ae, entries=2, sequenceid=17, filesize=5.1 K 2023-03-07 10:55:47,471 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for a270310ad72fe35b8edc286783c8e2c2 in 1259ms, sequenceid=17, compaction requested=true 2023-03-07 10:55:47,471 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a270310ad72fe35b8edc286783c8e2c2: 2023-03-07 10:55:47,471 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. 2023-03-07 10:55:47,472 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-07 10:55:47,851 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/.tmp/family2/30ab7d33f3ca4833a25d0074d0494d72 2023-03-07 10:55:47,855 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/.tmp/family1/3c83d8cabeb746d2a4a962bff69d9b48 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/3c83d8cabeb746d2a4a962bff69d9b48 2023-03-07 10:55:47,858 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/3c83d8cabeb746d2a4a962bff69d9b48, entries=4, sequenceid=17, filesize=5.4 K 2023-03-07 10:55:47,859 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/.tmp/family2/30ab7d33f3ca4833a25d0074d0494d72 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/30ab7d33f3ca4833a25d0074d0494d72 2023-03-07 10:55:47,862 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/30ab7d33f3ca4833a25d0074d0494d72, entries=2, sequenceid=17, filesize=5.1 K 2023-03-07 10:55:47,863 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for a8da3ca5bc578b596af4858d20f27e6c in 1654ms, sequenceid=17, compaction requested=true 2023-03-07 10:55:47,863 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a8da3ca5bc578b596af4858d20f27e6c: 2023-03-07 10:55:47,863 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. 2023-03-07 10:55:47,863 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-07 10:55:47,863 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-07 10:55:47,863 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:47,863 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-07 10:55:47,863 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-07 10:55:47,865 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:47,865 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:47,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:47,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:47,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:47,866 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:47,866 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:55:47,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:47,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:47,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:47,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:47,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:47,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-07 10:55:47,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b1f8110[Count = 0] remaining members to acquire global barrier 2023-03-07 10:55:47,867 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-07 10:55:47,867 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:47,868 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:47,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:47,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:47,868 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-07 10:55:47,868 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-07 10:55:47,868 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:55:47,868 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:47,868 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:55:47,870 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-07 10:55:47,870 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:55:47,870 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:47,870 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-07 10:55:47,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:47,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:47,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:47,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:47,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:47,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:47,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:47,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:47,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:47,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:47,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:55:47,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-07 10:55:47,872 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-07 10:55:47,872 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:55:47,872 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:55:47,872 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-07 10:55:47,872 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:55:47,874 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:47,874 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:47,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:47,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:47,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:47,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:47,874 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:55:47,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:47,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:47,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:55:47,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:55:47,875 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:47,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:47,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:47,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:47,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:47,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:47,876 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:47,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:47,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:47,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:47,881 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:47,881 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:55:47,881 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-07 10:55:47,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:55:47,882 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:55:47,882 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-07 10:55:47,882 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:55:47,882 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:47,882 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:47,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-07 10:55:47,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-07 10:55:47,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:55:47,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:55:47,882 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:47,882 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:47,882 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-07 10:55:47,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:55:47,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:55:47,882 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:55:47,983 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:55:47,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:55:47,992 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-07 10:55:47,999 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-07 10:55:48,007 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-07 10:55:48,009 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-07 10:55:48,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:55:48,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-07 10:55:48,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-07 10:55:48,038 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-07 10:55:48,038 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:55:48,038 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-07 10:55:48,038 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-07 10:55:48,039 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:48,039 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-07 10:55:48,040 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:48,040 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:55:48,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:55:48,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:55:48,040 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:48,040 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:55:48,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-07 10:55:48,041 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:48,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:55:48,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-07 10:55:48,041 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-07 10:55:48,041 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-07 10:55:48,041 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-07 10:55:48,041 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-07 10:55:48,041 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:55:48,042 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-07 10:55:48,042 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. 2023-03-07 10:55:48,042 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. started... 2023-03-07 10:55:48,042 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. 2023-03-07 10:55:48,042 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-07 10:55:48,042 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:55:48,042 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a8da3ca5bc578b596af4858d20f27e6c 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-07 10:55:48,042 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. started... 2023-03-07 10:55:48,042 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. 2023-03-07 10:55:48,042 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a270310ad72fe35b8edc286783c8e2c2 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-07 10:55:48,042 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. started... 2023-03-07 10:55:48,042 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 53e5fe74e89a0e6cfd7117280e42010d 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-07 10:55:48,073 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/.tmp/family1/dbc99a586e7b45a5a338a11ad2e5c8a7 2023-03-07 10:55:48,074 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/.tmp/family1/f99ed50618624a309b20d758bd974ae1 2023-03-07 10:55:48,077 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dbc99a586e7b45a5a338a11ad2e5c8a7 2023-03-07 10:55:48,077 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f99ed50618624a309b20d758bd974ae1 2023-03-07 10:55:48,870 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/.tmp/family1/e2c520d8c2e2420281af386c748591ac 2023-03-07 10:55:48,874 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e2c520d8c2e2420281af386c748591ac 2023-03-07 10:55:48,891 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/.tmp/family2/6cb6aa6b67e04ea6a574fd491eddb5cb 2023-03-07 10:55:48,894 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6cb6aa6b67e04ea6a574fd491eddb5cb 2023-03-07 10:55:48,895 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/.tmp/family1/f99ed50618624a309b20d758bd974ae1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/f99ed50618624a309b20d758bd974ae1 2023-03-07 10:55:48,895 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/.tmp/family2/49698472f829437d9890ff7ff528b877 2023-03-07 10:55:48,898 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 49698472f829437d9890ff7ff528b877 2023-03-07 10:55:48,899 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f99ed50618624a309b20d758bd974ae1 2023-03-07 10:55:48,899 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/f99ed50618624a309b20d758bd974ae1, entries=3, sequenceid=23, filesize=5.0 K 2023-03-07 10:55:48,899 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/.tmp/family1/dbc99a586e7b45a5a338a11ad2e5c8a7 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/dbc99a586e7b45a5a338a11ad2e5c8a7 2023-03-07 10:55:48,900 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/.tmp/family2/6cb6aa6b67e04ea6a574fd491eddb5cb as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/6cb6aa6b67e04ea6a574fd491eddb5cb 2023-03-07 10:55:48,903 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dbc99a586e7b45a5a338a11ad2e5c8a7 2023-03-07 10:55:48,903 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/dbc99a586e7b45a5a338a11ad2e5c8a7, entries=3, sequenceid=23, filesize=5.0 K 2023-03-07 10:55:48,903 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6cb6aa6b67e04ea6a574fd491eddb5cb 2023-03-07 10:55:48,903 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/6cb6aa6b67e04ea6a574fd491eddb5cb, entries=1, sequenceid=23, filesize=5.0 K 2023-03-07 10:55:48,904 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/.tmp/family2/49698472f829437d9890ff7ff528b877 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/49698472f829437d9890ff7ff528b877 2023-03-07 10:55:48,904 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for a8da3ca5bc578b596af4858d20f27e6c in 862ms, sequenceid=23, compaction requested=true 2023-03-07 10:55:48,904 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a8da3ca5bc578b596af4858d20f27e6c: 2023-03-07 10:55:48,904 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. 2023-03-07 10:55:48,904 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-07 10:55:48,908 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 49698472f829437d9890ff7ff528b877 2023-03-07 10:55:48,908 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/49698472f829437d9890ff7ff528b877, entries=1, sequenceid=23, filesize=5.0 K 2023-03-07 10:55:48,909 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 53e5fe74e89a0e6cfd7117280e42010d in 867ms, sequenceid=23, compaction requested=true 2023-03-07 10:55:48,909 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 53e5fe74e89a0e6cfd7117280e42010d: 2023-03-07 10:55:48,909 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. 2023-03-07 10:55:48,909 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-07 10:55:49,685 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/.tmp/family2/49946ead32234e4db93f7f891e9a4df6 2023-03-07 10:55:49,689 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 49946ead32234e4db93f7f891e9a4df6 2023-03-07 10:55:49,689 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/.tmp/family1/e2c520d8c2e2420281af386c748591ac as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/e2c520d8c2e2420281af386c748591ac 2023-03-07 10:55:49,693 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e2c520d8c2e2420281af386c748591ac 2023-03-07 10:55:49,693 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/e2c520d8c2e2420281af386c748591ac, entries=3, sequenceid=23, filesize=5.0 K 2023-03-07 10:55:49,694 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/.tmp/family2/49946ead32234e4db93f7f891e9a4df6 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/49946ead32234e4db93f7f891e9a4df6 2023-03-07 10:55:49,697 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 49946ead32234e4db93f7f891e9a4df6 2023-03-07 10:55:49,697 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/49946ead32234e4db93f7f891e9a4df6, entries=1, sequenceid=23, filesize=5.0 K 2023-03-07 10:55:49,698 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for a270310ad72fe35b8edc286783c8e2c2 in 1656ms, sequenceid=23, compaction requested=true 2023-03-07 10:55:49,698 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a270310ad72fe35b8edc286783c8e2c2: 2023-03-07 10:55:49,698 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. 2023-03-07 10:55:49,698 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-07 10:55:49,698 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-07 10:55:49,698 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:49,698 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-07 10:55:49,698 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-07 10:55:49,700 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:49,700 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:49,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:49,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:49,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:49,700 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:49,700 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:55:49,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:49,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:49,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:49,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:49,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:49,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-07 10:55:49,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37eceb92[Count = 0] remaining members to acquire global barrier 2023-03-07 10:55:49,701 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-07 10:55:49,701 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:49,702 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:49,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:49,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:49,703 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-07 10:55:49,703 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:49,703 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:55:49,703 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-07 10:55:49,703 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:55:49,705 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:49,705 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-07 10:55:49,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:49,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:49,705 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:55:49,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:49,705 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-07 10:55:49,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:49,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:49,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:49,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:49,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:49,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:49,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:49,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:55:49,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-07 10:55:49,707 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-07 10:55:49,708 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:55:49,708 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:55:49,708 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-07 10:55:49,708 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:55:49,712 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:49,712 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:49,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:49,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:55:49,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:55:49,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:49,712 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:55:49,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:49,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:55:49,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:55:49,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:55:49,713 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:49,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:49,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:49,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:55:49,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:49,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:49,714 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:49,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:55:49,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-07 10:55:49,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:49,716 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:49,716 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-07 10:55:49,716 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-07 10:55:49,716 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:49,716 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:49,716 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-07 10:55:49,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-07 10:55:49,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:55:49,716 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:55:49,716 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-07 10:55:49,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:55:49,716 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:55:49,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:55:49,717 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-07 10:55:49,716 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:55:49,717 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:55:49,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:55:49,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:55:49,817 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:55:49,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:55:49,818 DEBUG [Listener at localhost/42383] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-07 10:55:49,819 DEBUG [Listener at localhost/42383] regionserver.HStore(1912): a8da3ca5bc578b596af4858d20f27e6c/family1 is initiating major compaction (all files) 2023-03-07 10:55:49,819 INFO [Listener at localhost/42383] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-07 10:55:49,819 INFO [Listener at localhost/42383] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-07 10:55:49,819 INFO [Listener at localhost/42383] regionserver.HRegion(2259): Starting compaction of a8da3ca5bc578b596af4858d20f27e6c/family1 in ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. 2023-03-07 10:55:49,819 INFO [Listener at localhost/42383] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/42d7983cac524fe08ecb104cd3569e33, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/36719abc05c1475894f9ab9064b99a82, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/e8cbe8a8a11f410b85d0c7b70192315f, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/3c83d8cabeb746d2a4a962bff69d9b48, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/f99ed50618624a309b20d758bd974ae1] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/.tmp, totalSize=26.6 K 2023-03-07 10:55:49,820 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 42d7983cac524fe08ecb104cd3569e33, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678186540848 2023-03-07 10:55:49,820 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 36719abc05c1475894f9ab9064b99a82, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678186542642 2023-03-07 10:55:49,821 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting e8cbe8a8a11f410b85d0c7b70192315f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678186544424 2023-03-07 10:55:49,821 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 3c83d8cabeb746d2a4a962bff69d9b48, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678186546201 2023-03-07 10:55:49,822 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting f99ed50618624a309b20d758bd974ae1, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-07 10:55:49,832 INFO [Listener at localhost/42383] throttle.PressureAwareThroughputController(145): a8da3ca5bc578b596af4858d20f27e6c#family1#compaction#150 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:55:49,839 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230307959c78cb34664e4a98946c0a4ef77468_del 2023-03-07 10:55:49,839 INFO [Listener at localhost/42383] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230307959c78cb34664e4a98946c0a4ef77468_del to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230307959c78cb34664e4a98946c0a4ef77468_del 2023-03-07 10:55:50,652 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4b8210150bd34d15bb4cd6230ec4ea51 2023-03-07 10:55:50,653 DEBUG [Listener at localhost/42383] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/.tmp/family1/4b8210150bd34d15bb4cd6230ec4ea51 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/4b8210150bd34d15bb4cd6230ec4ea51 2023-03-07 10:55:50,657 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4b8210150bd34d15bb4cd6230ec4ea51 2023-03-07 10:55:50,658 INFO [Listener at localhost/42383] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a8da3ca5bc578b596af4858d20f27e6c/family1 of a8da3ca5bc578b596af4858d20f27e6c into 4b8210150bd34d15bb4cd6230ec4ea51(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-07 10:55:50,658 DEBUG [Listener at localhost/42383] regionserver.HRegion(2289): Compaction status journal for a8da3ca5bc578b596af4858d20f27e6c: 2023-03-07 10:55:50,658 DEBUG [Listener at localhost/42383] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-07 10:55:50,658 DEBUG [Listener at localhost/42383] regionserver.HStore(1912): a8da3ca5bc578b596af4858d20f27e6c/family2 is initiating major compaction (all files) 2023-03-07 10:55:50,658 INFO [Listener at localhost/42383] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-07 10:55:50,659 INFO [Listener at localhost/42383] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-07 10:55:50,659 INFO [Listener at localhost/42383] regionserver.HRegion(2259): Starting compaction of a8da3ca5bc578b596af4858d20f27e6c/family2 in ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. 2023-03-07 10:55:50,660 INFO [Listener at localhost/42383] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/bbb32dfe0ae54a1cb5c274879ad66688, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/6a850968a188490bb85a0264fc34e19d, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/860847f6a836489bbeb072cc9187df91, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/30ab7d33f3ca4833a25d0074d0494d72, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/6cb6aa6b67e04ea6a574fd491eddb5cb] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/.tmp, totalSize=25.3 K 2023-03-07 10:55:50,660 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting bbb32dfe0ae54a1cb5c274879ad66688, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678186540848 2023-03-07 10:55:50,661 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 6a850968a188490bb85a0264fc34e19d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678186542642 2023-03-07 10:55:50,661 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 860847f6a836489bbeb072cc9187df91, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678186544424 2023-03-07 10:55:50,661 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 30ab7d33f3ca4833a25d0074d0494d72, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678186546201 2023-03-07 10:55:50,662 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 6cb6aa6b67e04ea6a574fd491eddb5cb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-07 10:55:50,670 INFO [Listener at localhost/42383] throttle.PressureAwareThroughputController(145): a8da3ca5bc578b596af4858d20f27e6c#family2#compaction#151 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:55:50,679 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/42d7983cac524fe08ecb104cd3569e33, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/36719abc05c1475894f9ab9064b99a82, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/e8cbe8a8a11f410b85d0c7b70192315f, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/3c83d8cabeb746d2a4a962bff69d9b48, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/f99ed50618624a309b20d758bd974ae1] to archive 2023-03-07 10:55:50,680 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:50,681 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/42d7983cac524fe08ecb104cd3569e33 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/42d7983cac524fe08ecb104cd3569e33 2023-03-07 10:55:50,682 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/36719abc05c1475894f9ab9064b99a82 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/36719abc05c1475894f9ab9064b99a82 2023-03-07 10:55:50,683 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/e8cbe8a8a11f410b85d0c7b70192315f to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/e8cbe8a8a11f410b85d0c7b70192315f 2023-03-07 10:55:50,684 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/3c83d8cabeb746d2a4a962bff69d9b48 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/3c83d8cabeb746d2a4a962bff69d9b48 2023-03-07 10:55:50,685 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/f99ed50618624a309b20d758bd974ae1 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/f99ed50618624a309b20d758bd974ae1 2023-03-07 10:55:51,079 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023030704279a202b2f4f50ba5e3cc64a588251_del 2023-03-07 10:55:51,079 INFO [Listener at localhost/42383] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023030704279a202b2f4f50ba5e3cc64a588251_del to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023030704279a202b2f4f50ba5e3cc64a588251_del 2023-03-07 10:55:51,892 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 84a455c8b9cf403a84524bc4d803eae2 2023-03-07 10:55:51,893 DEBUG [Listener at localhost/42383] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/.tmp/family2/84a455c8b9cf403a84524bc4d803eae2 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/84a455c8b9cf403a84524bc4d803eae2 2023-03-07 10:55:51,896 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 84a455c8b9cf403a84524bc4d803eae2 2023-03-07 10:55:51,897 INFO [Listener at localhost/42383] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a8da3ca5bc578b596af4858d20f27e6c/family2 of a8da3ca5bc578b596af4858d20f27e6c into 84a455c8b9cf403a84524bc4d803eae2(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-07 10:55:51,897 DEBUG [Listener at localhost/42383] regionserver.HRegion(2289): Compaction status journal for a8da3ca5bc578b596af4858d20f27e6c: 2023-03-07 10:55:51,897 DEBUG [Listener at localhost/42383] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-07 10:55:51,897 DEBUG [Listener at localhost/42383] regionserver.HStore(1912): a270310ad72fe35b8edc286783c8e2c2/family1 is initiating major compaction (all files) 2023-03-07 10:55:51,897 INFO [Listener at localhost/42383] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-07 10:55:51,897 INFO [Listener at localhost/42383] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-07 10:55:51,897 INFO [Listener at localhost/42383] regionserver.HRegion(2259): Starting compaction of a270310ad72fe35b8edc286783c8e2c2/family1 in ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. 2023-03-07 10:55:51,898 INFO [Listener at localhost/42383] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/22189b6690c04552af0ee88c996a67ee, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/63c338af3fe44521bc45b19baae689b2, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/2fc9b56c01744b1297289aaec80cb292, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/b801be77fec44a10bf6e34390a50e8cb, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/e2c520d8c2e2420281af386c748591ac] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/.tmp, totalSize=26.6 K 2023-03-07 10:55:51,898 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 22189b6690c04552af0ee88c996a67ee, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678186540848 2023-03-07 10:55:51,898 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 63c338af3fe44521bc45b19baae689b2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678186542642 2023-03-07 10:55:51,899 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 2fc9b56c01744b1297289aaec80cb292, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678186544424 2023-03-07 10:55:51,899 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting b801be77fec44a10bf6e34390a50e8cb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678186546201 2023-03-07 10:55:51,899 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting e2c520d8c2e2420281af386c748591ac, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-07 10:55:51,907 INFO [Listener at localhost/42383] throttle.PressureAwareThroughputController(145): a270310ad72fe35b8edc286783c8e2c2#family1#compaction#152 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:55:51,982 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/bbb32dfe0ae54a1cb5c274879ad66688, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/6a850968a188490bb85a0264fc34e19d, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/860847f6a836489bbeb072cc9187df91, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/30ab7d33f3ca4833a25d0074d0494d72, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/6cb6aa6b67e04ea6a574fd491eddb5cb] to archive 2023-03-07 10:55:51,983 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:51,985 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/bbb32dfe0ae54a1cb5c274879ad66688 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/bbb32dfe0ae54a1cb5c274879ad66688 2023-03-07 10:55:51,986 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/6a850968a188490bb85a0264fc34e19d to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/6a850968a188490bb85a0264fc34e19d 2023-03-07 10:55:51,987 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/860847f6a836489bbeb072cc9187df91 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/860847f6a836489bbeb072cc9187df91 2023-03-07 10:55:51,987 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/30ab7d33f3ca4833a25d0074d0494d72 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/30ab7d33f3ca4833a25d0074d0494d72 2023-03-07 10:55:51,988 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/6cb6aa6b67e04ea6a574fd491eddb5cb to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family2/6cb6aa6b67e04ea6a574fd491eddb5cb 2023-03-07 10:55:52,315 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230307fc0813ad2e2e410ebb38cf825fe48e5e_del 2023-03-07 10:55:52,315 INFO [Listener at localhost/42383] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230307fc0813ad2e2e410ebb38cf825fe48e5e_del to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230307fc0813ad2e2e410ebb38cf825fe48e5e_del 2023-03-07 10:55:53,129 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6940389418484fc7a285f52b0f729b43 2023-03-07 10:55:53,129 DEBUG [Listener at localhost/42383] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/.tmp/family1/6940389418484fc7a285f52b0f729b43 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/6940389418484fc7a285f52b0f729b43 2023-03-07 10:55:53,133 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6940389418484fc7a285f52b0f729b43 2023-03-07 10:55:53,134 INFO [Listener at localhost/42383] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a270310ad72fe35b8edc286783c8e2c2/family1 of a270310ad72fe35b8edc286783c8e2c2 into 6940389418484fc7a285f52b0f729b43(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-07 10:55:53,134 DEBUG [Listener at localhost/42383] regionserver.HRegion(2289): Compaction status journal for a270310ad72fe35b8edc286783c8e2c2: 2023-03-07 10:55:53,134 DEBUG [Listener at localhost/42383] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-07 10:55:53,134 DEBUG [Listener at localhost/42383] regionserver.HStore(1912): a270310ad72fe35b8edc286783c8e2c2/family2 is initiating major compaction (all files) 2023-03-07 10:55:53,134 INFO [Listener at localhost/42383] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-07 10:55:53,134 INFO [Listener at localhost/42383] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-07 10:55:53,134 INFO [Listener at localhost/42383] regionserver.HRegion(2259): Starting compaction of a270310ad72fe35b8edc286783c8e2c2/family2 in ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. 2023-03-07 10:55:53,135 INFO [Listener at localhost/42383] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/7199dc1167224d30aff4cabce4bcdbbd, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/0b44be6b4c1b4cbc8ab8d5a7db02383f, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/5603504f3a264d68b523c112c82a6312, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/b45bfda64da1490d9a3e5a36c39187ae, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/49946ead32234e4db93f7f891e9a4df6] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/.tmp, totalSize=25.3 K 2023-03-07 10:55:53,135 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 7199dc1167224d30aff4cabce4bcdbbd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678186540848 2023-03-07 10:55:53,135 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 0b44be6b4c1b4cbc8ab8d5a7db02383f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678186542642 2023-03-07 10:55:53,136 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 5603504f3a264d68b523c112c82a6312, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678186544424 2023-03-07 10:55:53,136 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting b45bfda64da1490d9a3e5a36c39187ae, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678186546201 2023-03-07 10:55:53,136 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 49946ead32234e4db93f7f891e9a4df6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-07 10:55:53,145 INFO [Listener at localhost/42383] throttle.PressureAwareThroughputController(145): a270310ad72fe35b8edc286783c8e2c2#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:55:53,180 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/22189b6690c04552af0ee88c996a67ee, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/63c338af3fe44521bc45b19baae689b2, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/2fc9b56c01744b1297289aaec80cb292, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/b801be77fec44a10bf6e34390a50e8cb, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/e2c520d8c2e2420281af386c748591ac] to archive 2023-03-07 10:55:53,181 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:53,182 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/22189b6690c04552af0ee88c996a67ee to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/22189b6690c04552af0ee88c996a67ee 2023-03-07 10:55:53,183 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/63c338af3fe44521bc45b19baae689b2 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/63c338af3fe44521bc45b19baae689b2 2023-03-07 10:55:53,184 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/2fc9b56c01744b1297289aaec80cb292 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/2fc9b56c01744b1297289aaec80cb292 2023-03-07 10:55:53,185 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/b801be77fec44a10bf6e34390a50e8cb to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/b801be77fec44a10bf6e34390a50e8cb 2023-03-07 10:55:53,186 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/e2c520d8c2e2420281af386c748591ac to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/e2c520d8c2e2420281af386c748591ac 2023-03-07 10:55:53,555 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230307658e5733c84d41d3bf73a70f8c08ea20_del 2023-03-07 10:55:53,555 INFO [Listener at localhost/42383] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230307658e5733c84d41d3bf73a70f8c08ea20_del to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230307658e5733c84d41d3bf73a70f8c08ea20_del 2023-03-07 10:55:54,369 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dc05a2c075344af880f1b70ad59c23d3 2023-03-07 10:55:54,370 DEBUG [Listener at localhost/42383] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/.tmp/family2/dc05a2c075344af880f1b70ad59c23d3 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/dc05a2c075344af880f1b70ad59c23d3 2023-03-07 10:55:54,373 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dc05a2c075344af880f1b70ad59c23d3 2023-03-07 10:55:54,374 INFO [Listener at localhost/42383] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a270310ad72fe35b8edc286783c8e2c2/family2 of a270310ad72fe35b8edc286783c8e2c2 into dc05a2c075344af880f1b70ad59c23d3(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-07 10:55:54,375 DEBUG [Listener at localhost/42383] regionserver.HRegion(2289): Compaction status journal for a270310ad72fe35b8edc286783c8e2c2: 2023-03-07 10:55:54,375 DEBUG [Listener at localhost/42383] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-07 10:55:54,375 DEBUG [Listener at localhost/42383] regionserver.HStore(1912): 53e5fe74e89a0e6cfd7117280e42010d/family1 is initiating major compaction (all files) 2023-03-07 10:55:54,375 INFO [Listener at localhost/42383] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-07 10:55:54,375 INFO [Listener at localhost/42383] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-07 10:55:54,376 INFO [Listener at localhost/42383] regionserver.HRegion(2259): Starting compaction of 53e5fe74e89a0e6cfd7117280e42010d/family1 in ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. 2023-03-07 10:55:54,376 INFO [Listener at localhost/42383] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/07431787ee03449b8b6fe36529692675, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/e70c8db48f98440e9281fa5803e7433b, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/268e3978eb884d98a8dd6ddceb6fbe99, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/694299ef14e84b2eb2aba3d1f16d7c20, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/dbc99a586e7b45a5a338a11ad2e5c8a7] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/.tmp, totalSize=26.6 K 2023-03-07 10:55:54,377 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 07431787ee03449b8b6fe36529692675, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678186540847 2023-03-07 10:55:54,377 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting e70c8db48f98440e9281fa5803e7433b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678186542642 2023-03-07 10:55:54,377 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 268e3978eb884d98a8dd6ddceb6fbe99, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678186544423 2023-03-07 10:55:54,378 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 694299ef14e84b2eb2aba3d1f16d7c20, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678186546201 2023-03-07 10:55:54,378 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting dbc99a586e7b45a5a338a11ad2e5c8a7, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-07 10:55:54,379 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/7199dc1167224d30aff4cabce4bcdbbd, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/0b44be6b4c1b4cbc8ab8d5a7db02383f, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/5603504f3a264d68b523c112c82a6312, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/b45bfda64da1490d9a3e5a36c39187ae, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/49946ead32234e4db93f7f891e9a4df6] to archive 2023-03-07 10:55:54,380 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:54,382 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/7199dc1167224d30aff4cabce4bcdbbd to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/7199dc1167224d30aff4cabce4bcdbbd 2023-03-07 10:55:54,383 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/0b44be6b4c1b4cbc8ab8d5a7db02383f to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/0b44be6b4c1b4cbc8ab8d5a7db02383f 2023-03-07 10:55:54,384 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/5603504f3a264d68b523c112c82a6312 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/5603504f3a264d68b523c112c82a6312 2023-03-07 10:55:54,385 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/b45bfda64da1490d9a3e5a36c39187ae to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/b45bfda64da1490d9a3e5a36c39187ae 2023-03-07 10:55:54,386 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/49946ead32234e4db93f7f891e9a4df6 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family2/49946ead32234e4db93f7f891e9a4df6 2023-03-07 10:55:54,387 INFO [Listener at localhost/42383] throttle.PressureAwareThroughputController(145): 53e5fe74e89a0e6cfd7117280e42010d#family1#compaction#154 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:55:54,795 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303076bf8558b99234e878d86ff2135b2dad5_del 2023-03-07 10:55:54,795 INFO [Listener at localhost/42383] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303076bf8558b99234e878d86ff2135b2dad5_del to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303076bf8558b99234e878d86ff2135b2dad5_del 2023-03-07 10:55:55,610 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c2445934c5fa4579abba45cfd9e8032f 2023-03-07 10:55:55,611 DEBUG [Listener at localhost/42383] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/.tmp/family1/c2445934c5fa4579abba45cfd9e8032f as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/c2445934c5fa4579abba45cfd9e8032f 2023-03-07 10:55:55,615 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c2445934c5fa4579abba45cfd9e8032f 2023-03-07 10:55:55,616 INFO [Listener at localhost/42383] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 53e5fe74e89a0e6cfd7117280e42010d/family1 of 53e5fe74e89a0e6cfd7117280e42010d into c2445934c5fa4579abba45cfd9e8032f(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-07 10:55:55,616 DEBUG [Listener at localhost/42383] regionserver.HRegion(2289): Compaction status journal for 53e5fe74e89a0e6cfd7117280e42010d: 2023-03-07 10:55:55,616 DEBUG [Listener at localhost/42383] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-07 10:55:55,616 DEBUG [Listener at localhost/42383] regionserver.HStore(1912): 53e5fe74e89a0e6cfd7117280e42010d/family2 is initiating major compaction (all files) 2023-03-07 10:55:55,616 INFO [Listener at localhost/42383] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-07 10:55:55,617 INFO [Listener at localhost/42383] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-07 10:55:55,617 INFO [Listener at localhost/42383] regionserver.HRegion(2259): Starting compaction of 53e5fe74e89a0e6cfd7117280e42010d/family2 in ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. 2023-03-07 10:55:55,617 INFO [Listener at localhost/42383] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/f3664a8332d9477e975137dfffada2d2, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/3cc2d761a018465489a1370ef5512401, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/749c1617d8ab4a34b80c21980e1feb18, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/def42fda7d4f4d0ebb73479f126aa211, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/49698472f829437d9890ff7ff528b877] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/.tmp, totalSize=25.3 K 2023-03-07 10:55:55,617 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting f3664a8332d9477e975137dfffada2d2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678186540847 2023-03-07 10:55:55,618 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 3cc2d761a018465489a1370ef5512401, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678186542642 2023-03-07 10:55:55,618 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 749c1617d8ab4a34b80c21980e1feb18, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678186544423 2023-03-07 10:55:55,619 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting def42fda7d4f4d0ebb73479f126aa211, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678186546201 2023-03-07 10:55:55,619 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 49698472f829437d9890ff7ff528b877, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-07 10:55:55,632 INFO [Listener at localhost/42383] throttle.PressureAwareThroughputController(145): 53e5fe74e89a0e6cfd7117280e42010d#family2#compaction#155 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:55:55,684 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/07431787ee03449b8b6fe36529692675, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/e70c8db48f98440e9281fa5803e7433b, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/268e3978eb884d98a8dd6ddceb6fbe99, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/694299ef14e84b2eb2aba3d1f16d7c20, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/dbc99a586e7b45a5a338a11ad2e5c8a7] to archive 2023-03-07 10:55:55,685 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:55,688 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/07431787ee03449b8b6fe36529692675 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/07431787ee03449b8b6fe36529692675 2023-03-07 10:55:55,689 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/e70c8db48f98440e9281fa5803e7433b to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/e70c8db48f98440e9281fa5803e7433b 2023-03-07 10:55:55,690 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/268e3978eb884d98a8dd6ddceb6fbe99 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/268e3978eb884d98a8dd6ddceb6fbe99 2023-03-07 10:55:55,691 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/694299ef14e84b2eb2aba3d1f16d7c20 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/694299ef14e84b2eb2aba3d1f16d7c20 2023-03-07 10:55:55,692 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/dbc99a586e7b45a5a338a11ad2e5c8a7 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/dbc99a586e7b45a5a338a11ad2e5c8a7 2023-03-07 10:55:56,041 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023030701e2994f19fc473a8bd93cc6c2edabc3_del 2023-03-07 10:55:56,041 INFO [Listener at localhost/42383] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023030701e2994f19fc473a8bd93cc6c2edabc3_del to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023030701e2994f19fc473a8bd93cc6c2edabc3_del 2023-03-07 10:55:56,856 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 507afdf44a5d4030bb8c29682e7b67e9 2023-03-07 10:55:56,857 DEBUG [Listener at localhost/42383] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/.tmp/family2/507afdf44a5d4030bb8c29682e7b67e9 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/507afdf44a5d4030bb8c29682e7b67e9 2023-03-07 10:55:56,860 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 507afdf44a5d4030bb8c29682e7b67e9 2023-03-07 10:55:56,861 INFO [Listener at localhost/42383] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 53e5fe74e89a0e6cfd7117280e42010d/family2 of 53e5fe74e89a0e6cfd7117280e42010d into 507afdf44a5d4030bb8c29682e7b67e9(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-07 10:55:56,861 DEBUG [Listener at localhost/42383] regionserver.HRegion(2289): Compaction status journal for 53e5fe74e89a0e6cfd7117280e42010d: 2023-03-07 10:55:56,863 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-07 10:55:56,866 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-07 10:55:56,869 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-07 10:55:56,870 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-07 10:55:56,875 INFO [Listener at localhost/42383] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-07 10:55:56,883 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/f3664a8332d9477e975137dfffada2d2, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/3cc2d761a018465489a1370ef5512401, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/749c1617d8ab4a34b80c21980e1feb18, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/def42fda7d4f4d0ebb73479f126aa211, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/49698472f829437d9890ff7ff528b877] to archive 2023-03-07 10:55:56,883 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:56,885 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/f3664a8332d9477e975137dfffada2d2 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/f3664a8332d9477e975137dfffada2d2 2023-03-07 10:55:56,887 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/3cc2d761a018465489a1370ef5512401 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/3cc2d761a018465489a1370ef5512401 2023-03-07 10:55:56,889 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/749c1617d8ab4a34b80c21980e1feb18 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/749c1617d8ab4a34b80c21980e1feb18 2023-03-07 10:55:56,890 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/def42fda7d4f4d0ebb73479f126aa211 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/def42fda7d4f4d0ebb73479f126aa211 2023-03-07 10:55:56,891 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/49698472f829437d9890ff7ff528b877 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family2/49698472f829437d9890ff7ff528b877 2023-03-07 10:55:56,892 INFO [Listener at localhost/42383] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-03-07 10:55:56,895 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303076bf8558b99234e878d86ff2135b2dad5_del 2023-03-07 10:55:56,899 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230307fc0813ad2e2e410ebb38cf825fe48e5e_del 2023-03-07 10:55:56,902 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230307959c78cb34664e4a98946c0a4ef77468_del 2023-03-07 10:55:56,902 INFO [Listener at localhost/42383] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-03-07 10:55:56,902 DEBUG [Listener at localhost/42383] zookeeper.ReadOnlyZKClient(139): Connect 0x1a0f9b20 to 127.0.0.1:56055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-07 10:55:56,907 DEBUG [Listener at localhost/42383] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f6c2fc6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-07 10:55:56,909 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230307 for table='ns:testMinorCompaction' and column='family1' 2023-03-07 10:55:56,909 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230307 for table='ns:testMinorCompaction' and column='family1' 2023-03-07 10:55:56,909 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230307 for table='ns:testMinorCompaction' and column='family1' 2023-03-07 10:55:57,334 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230307e820019985dc4e82b1b3e2335067258d to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230307e820019985dc4e82b1b3e2335067258d 2023-03-07 10:55:57,334 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023030758f6b0e957af4188b1416f7c6750f7be to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023030758f6b0e957af4188b1416f7c6750f7be 2023-03-07 10:55:57,335 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230307 table='ns:testMinorCompaction' column='family1' 2023-03-07 10:55:57,335 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230307 table='ns:testMinorCompaction' column='family1' 2023-03-07 10:55:57,350 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-07 10:55:57,352 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54090, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-07 10:55:57,360 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-07 10:55:57,363 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39734, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-07 10:55:57,382 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230307/family1/5af0ac5d7d8545129e545fd6ae46ae2e first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-03-07 10:55:57,383 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230307/family1/5af0ac5d7d8545129e545fd6ae46ae2e}] 2023-03-07 10:55:57,390 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230307/family1/5af0ac5d7d8545129e545fd6ae46ae2e for inclusion in a8da3ca5bc578b596af4858d20f27e6c/family1 2023-03-07 10:55:57,390 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230307/family1/2f7709ea6caa43f1ac1634f0ce64e599 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-03-07 10:55:57,391 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230307/family1/2f7709ea6caa43f1ac1634f0ce64e599}] 2023-03-07 10:55:57,393 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230307/family1/2f7709ea6caa43f1ac1634f0ce64e599 for inclusion in 53e5fe74e89a0e6cfd7117280e42010d/family1 2023-03-07 10:55:57,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-03-07 10:55:57,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-07 10:55:57,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for a8da3ca5bc578b596af4858d20f27e6c: 2023-03-07 10:55:57,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230307/family1/5af0ac5d7d8545129e545fd6ae46ae2e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__ns_testMinorCompaction__5asbhdtkrhfj7qt1vq6s51d6qbuta454p8seg3c7jci1o96mopan19cd3nbqh05n/family1/5af0ac5d7d8545129e545fd6ae46ae2e 2023-03-07 10:55:57,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-03-07 10:55:57,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(777): Region bounds: first= last=1 2023-03-07 10:55:57,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for 53e5fe74e89a0e6cfd7117280e42010d: 2023-03-07 10:55:57,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230307/family1/2f7709ea6caa43f1ac1634f0ce64e599 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__ns_testMinorCompaction__lt9jofulqo08bebncofuovdsjpc1t5t32t93eg2ievhuduf1osq65oqqb715uj1o/family1/2f7709ea6caa43f1ac1634f0ce64e599 2023-03-07 10:55:57,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__ns_testMinorCompaction__5asbhdtkrhfj7qt1vq6s51d6qbuta454p8seg3c7jci1o96mopan19cd3nbqh05n/family1/5af0ac5d7d8545129e545fd6ae46ae2e as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/043c059c197c49a1b35d1bfca8ed9150_SeqId_28_ 2023-03-07 10:55:57,398 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__ns_testMinorCompaction__5asbhdtkrhfj7qt1vq6s51d6qbuta454p8seg3c7jci1o96mopan19cd3nbqh05n/family1/5af0ac5d7d8545129e545fd6ae46ae2e into a8da3ca5bc578b596af4858d20f27e6c/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/043c059c197c49a1b35d1bfca8ed9150_SeqId_28_ - updating store file list. 2023-03-07 10:55:57,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__ns_testMinorCompaction__lt9jofulqo08bebncofuovdsjpc1t5t32t93eg2ievhuduf1osq65oqqb715uj1o/family1/2f7709ea6caa43f1ac1634f0ce64e599 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/5f49b905914c4ee9a90d2b2e2dd168ec_SeqId_28_ 2023-03-07 10:55:57,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__ns_testMinorCompaction__lt9jofulqo08bebncofuovdsjpc1t5t32t93eg2ievhuduf1osq65oqqb715uj1o/family1/2f7709ea6caa43f1ac1634f0ce64e599 into 53e5fe74e89a0e6cfd7117280e42010d/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/5f49b905914c4ee9a90d2b2e2dd168ec_SeqId_28_ - updating store file list. 2023-03-07 10:55:57,401 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/043c059c197c49a1b35d1bfca8ed9150_SeqId_28_ into a8da3ca5bc578b596af4858d20f27e6c/family1 2023-03-07 10:55:57,401 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__ns_testMinorCompaction__5asbhdtkrhfj7qt1vq6s51d6qbuta454p8seg3c7jci1o96mopan19cd3nbqh05n/family1/5af0ac5d7d8545129e545fd6ae46ae2e into a8da3ca5bc578b596af4858d20f27e6c/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/family1/043c059c197c49a1b35d1bfca8ed9150_SeqId_28_) 2023-03-07 10:55:57,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__ns_testMinorCompaction__5asbhdtkrhfj7qt1vq6s51d6qbuta454p8seg3c7jci1o96mopan19cd3nbqh05n/family1/5af0ac5d7d8545129e545fd6ae46ae2e 2023-03-07 10:55:57,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/5f49b905914c4ee9a90d2b2e2dd168ec_SeqId_28_ into 53e5fe74e89a0e6cfd7117280e42010d/family1 2023-03-07 10:55:57,404 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230307 table='ns:testMinorCompaction' column='family1' 2023-03-07 10:55:57,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__ns_testMinorCompaction__lt9jofulqo08bebncofuovdsjpc1t5t32t93eg2ievhuduf1osq65oqqb715uj1o/family1/2f7709ea6caa43f1ac1634f0ce64e599 into 53e5fe74e89a0e6cfd7117280e42010d/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/family1/5f49b905914c4ee9a90d2b2e2dd168ec_SeqId_28_) 2023-03-07 10:55:57,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__ns_testMinorCompaction__lt9jofulqo08bebncofuovdsjpc1t5t32t93eg2ievhuduf1osq65oqqb715uj1o/family1/2f7709ea6caa43f1ac1634f0ce64e599 2023-03-07 10:55:57,405 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:57,406 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230307d03693be120c4af0b921d0460b2fa746 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230307d03693be120c4af0b921d0460b2fa746 2023-03-07 10:55:57,406 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-07 10:55:57,406 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230307' 2023-03-07 10:55:57,407 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230307 table='ns:testMinorCompaction' column='family1' 2023-03-07 10:55:57,407 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230307 for table='ns:testMinorCompaction' and column='family1' 2023-03-07 10:55:57,407 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:57,408 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303077b292a0524cf48a8952d2fd4f4f1f8ee to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303077b292a0524cf48a8952d2fd4f4f1f8ee 2023-03-07 10:55:57,409 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-07 10:55:57,409 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230307' 2023-03-07 10:55:57,409 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230307 for table='ns:testMinorCompaction' and column='family1' 2023-03-07 10:55:57,733 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230307d4bc6121b3f64be9a7dfa564bfd8efbb to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230307d4bc6121b3f64be9a7dfa564bfd8efbb 2023-03-07 10:55:57,734 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230307 table='ns:testMinorCompaction' column='family1' 2023-03-07 10:55:57,757 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230307/family1/b14d12339d19466fb6604ab7fd9893e1 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-03-07 10:55:57,758 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230307/family1/b14d12339d19466fb6604ab7fd9893e1}] 2023-03-07 10:55:57,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230307/family1/b14d12339d19466fb6604ab7fd9893e1 for inclusion in a270310ad72fe35b8edc286783c8e2c2/family1 2023-03-07 10:55:57,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-03-07 10:55:57,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-07 10:55:57,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for a270310ad72fe35b8edc286783c8e2c2: 2023-03-07 10:55:57,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230307/family1/b14d12339d19466fb6604ab7fd9893e1 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__ns_testMinorCompaction__7u3jueoi6ic4ppdptnb2vfnktlali5rgqtco6mqhqnt277bheoo9g5qet0lihifo/family1/b14d12339d19466fb6604ab7fd9893e1 2023-03-07 10:55:57,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__ns_testMinorCompaction__7u3jueoi6ic4ppdptnb2vfnktlali5rgqtco6mqhqnt277bheoo9g5qet0lihifo/family1/b14d12339d19466fb6604ab7fd9893e1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/c990b1a8a9964b98a9634689ce859899_SeqId_28_ 2023-03-07 10:55:57,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__ns_testMinorCompaction__7u3jueoi6ic4ppdptnb2vfnktlali5rgqtco6mqhqnt277bheoo9g5qet0lihifo/family1/b14d12339d19466fb6604ab7fd9893e1 into a270310ad72fe35b8edc286783c8e2c2/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/c990b1a8a9964b98a9634689ce859899_SeqId_28_ - updating store file list. 2023-03-07 10:55:57,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/c990b1a8a9964b98a9634689ce859899_SeqId_28_ into a270310ad72fe35b8edc286783c8e2c2/family1 2023-03-07 10:55:57,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__ns_testMinorCompaction__7u3jueoi6ic4ppdptnb2vfnktlali5rgqtco6mqhqnt277bheoo9g5qet0lihifo/family1/b14d12339d19466fb6604ab7fd9893e1 into a270310ad72fe35b8edc286783c8e2c2/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/family1/c990b1a8a9964b98a9634689ce859899_SeqId_28_) 2023-03-07 10:55:57,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__ns_testMinorCompaction__7u3jueoi6ic4ppdptnb2vfnktlali5rgqtco6mqhqnt277bheoo9g5qet0lihifo/family1/b14d12339d19466fb6604ab7fd9893e1 2023-03-07 10:55:57,771 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230307 table='ns:testMinorCompaction' column='family1' 2023-03-07 10:55:57,771 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:55:57,772 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230307c53bb609ed794f9486ebb5c49d943e2b to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230307c53bb609ed794f9486ebb5c49d943e2b 2023-03-07 10:55:57,772 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-07 10:55:57,772 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230307' 2023-03-07 10:55:57,773 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230307 for table='ns:testMinorCompaction' and column='family1' 2023-03-07 10:55:57,773 INFO [Listener at localhost/42383] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-03-07 10:55:57,775 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-07 10:55:57,777 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-07 10:55:57,779 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-07 10:55:57,779 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-07 10:55:57,798 INFO [Listener at localhost/42383] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=253 (was 282), OpenFileDescriptor=633 (was 744), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=169 (was 158) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=9349 (was 9393) 2023-03-07 10:55:57,813 INFO [Listener at localhost/42383] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=253, OpenFileDescriptor=633, MaxFileDescriptor=60000, SystemLoadAverage=169, ProcessCount=171, AvailableMemoryMB=9349 2023-03-07 10:55:57,815 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-07 10:55:57,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-03-07 10:55:57,816 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-07 10:55:57,817 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-03-07 10:55:57,817 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-07 10:55:57,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-07 10:55:57,818 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6 2023-03-07 10:55:57,818 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6 empty. 2023-03-07 10:55:57,819 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6 2023-03-07 10:55:57,819 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-03-07 10:55:57,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-07 10:55:58,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-07 10:55:58,225 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-07 10:55:58,226 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 120edd0de8d32c55588e2c2646d330b6, NAME => 'testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp 2023-03-07 10:55:58,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-07 10:55:58,631 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:55:58,631 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 120edd0de8d32c55588e2c2646d330b6, disabling compactions & flushes 2023-03-07 10:55:58,631 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:55:58,631 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:55:58,632 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. after waiting 0 ms 2023-03-07 10:55:58,632 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:55:58,632 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:55:58,632 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 120edd0de8d32c55588e2c2646d330b6: 2023-03-07 10:55:58,633 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-07 10:55:58,634 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678186558634"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186558634"}]},"ts":"1678186558634"} 2023-03-07 10:55:58,636 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-07 10:55:58,636 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-07 10:55:58,636 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186558636"}]},"ts":"1678186558636"} 2023-03-07 10:55:58,637 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-03-07 10:55:58,641 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=120edd0de8d32c55588e2c2646d330b6, ASSIGN}] 2023-03-07 10:55:58,643 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=120edd0de8d32c55588e2c2646d330b6, ASSIGN 2023-03-07 10:55:58,643 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=120edd0de8d32c55588e2c2646d330b6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39673,1678186416064; forceNewPlan=false, retain=false 2023-03-07 10:55:58,794 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=120edd0de8d32c55588e2c2646d330b6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:58,794 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678186558794"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186558794"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186558794"}]},"ts":"1678186558794"} 2023-03-07 10:55:58,796 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 120edd0de8d32c55588e2c2646d330b6, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:55:58,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-07 10:55:58,951 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:55:58,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 120edd0de8d32c55588e2c2646d330b6, NAME => 'testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6.', STARTKEY => '', ENDKEY => ''} 2023-03-07 10:55:58,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 120edd0de8d32c55588e2c2646d330b6 2023-03-07 10:55:58,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:55:58,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 120edd0de8d32c55588e2c2646d330b6 2023-03-07 10:55:58,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 120edd0de8d32c55588e2c2646d330b6 2023-03-07 10:55:58,953 INFO [StoreOpener-120edd0de8d32c55588e2c2646d330b6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 120edd0de8d32c55588e2c2646d330b6 2023-03-07 10:55:58,954 DEBUG [StoreOpener-120edd0de8d32c55588e2c2646d330b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1 2023-03-07 10:55:58,955 DEBUG [StoreOpener-120edd0de8d32c55588e2c2646d330b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1 2023-03-07 10:55:58,955 INFO [StoreOpener-120edd0de8d32c55588e2c2646d330b6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 120edd0de8d32c55588e2c2646d330b6 columnFamilyName family1 2023-03-07 10:55:58,956 INFO [StoreOpener-120edd0de8d32c55588e2c2646d330b6-1] regionserver.HStore(310): Store=120edd0de8d32c55588e2c2646d330b6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:55:58,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6 2023-03-07 10:55:58,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6 2023-03-07 10:55:58,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 120edd0de8d32c55588e2c2646d330b6 2023-03-07 10:55:58,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-07 10:55:58,960 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 120edd0de8d32c55588e2c2646d330b6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61729965, jitterRate=-0.08015184104442596}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-07 10:55:58,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 120edd0de8d32c55588e2c2646d330b6: 2023-03-07 10:55:58,961 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6., pid=114, masterSystemTime=1678186558947 2023-03-07 10:55:58,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:55:58,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:55:58,962 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=120edd0de8d32c55588e2c2646d330b6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:58,963 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678186558962"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186558962"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186558962"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186558962"}]},"ts":"1678186558962"} 2023-03-07 10:55:58,965 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-03-07 10:55:58,965 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 120edd0de8d32c55588e2c2646d330b6, server=jenkins-hbase4.apache.org,39673,1678186416064 in 168 msec 2023-03-07 10:55:58,966 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-03-07 10:55:58,966 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=120edd0de8d32c55588e2c2646d330b6, ASSIGN in 324 msec 2023-03-07 10:55:58,966 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-07 10:55:58,966 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186558966"}]},"ts":"1678186558966"} 2023-03-07 10:55:58,967 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-03-07 10:55:58,969 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-07 10:55:58,970 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1540 sec 2023-03-07 10:55:59,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-07 10:55:59,922 INFO [Listener at localhost/42383] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-03-07 10:55:59,940 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:55:59,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-07 10:55:59,942 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-07 10:55:59,942 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:55:59,942 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-07 10:55:59,942 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-07 10:55:59,942 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:55:59,942 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:55:59,943 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:59,943 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:55:59,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:55:59,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:55:59,944 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:55:59,944 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:55:59,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:55:59,944 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:55:59,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:55:59,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:55:59,945 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-07 10:55:59,945 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-07 10:55:59,945 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-07 10:55:59,945 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:55:59,945 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-07 10:55:59,948 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:55:59,948 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:55:59,948 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:55:59,948 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. started... 2023-03-07 10:55:59,949 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 120edd0de8d32c55588e2c2646d330b6 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-07 10:55:59,967 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-07 10:55:59,967 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c07c47c to 127.0.0.1:56055 2023-03-07 10:55:59,967 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-07 10:55:59,967 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-07 10:55:59,968 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a0f9b20 to 127.0.0.1:56055 2023-03-07 10:55:59,968 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-07 10:55:59,969 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-07 10:55:59,969 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x567a176b to 127.0.0.1:56055 2023-03-07 10:55:59,969 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-07 10:56:00,384 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130a47d6c3bc5e74f408b35f7401111ceba to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130a47d6c3bc5e74f408b35f7401111ceba 2023-03-07 10:56:00,788 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/.tmp/family1/49ff8365a13f4f7dbde7374597ead526 2023-03-07 10:56:00,792 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/.tmp/family1/49ff8365a13f4f7dbde7374597ead526 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/49ff8365a13f4f7dbde7374597ead526 2023-03-07 10:56:00,795 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/49ff8365a13f4f7dbde7374597ead526, entries=1000, sequenceid=5, filesize=166.0 K 2023-03-07 10:56:00,796 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 120edd0de8d32c55588e2c2646d330b6 in 847ms, sequenceid=5, compaction requested=false 2023-03-07 10:56:00,796 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-03-07 10:56:00,797 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 120edd0de8d32c55588e2c2646d330b6: 2023-03-07 10:56:00,797 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:56:00,797 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:56:00,797 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:56:00,797 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,797 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-07 10:56:00,797 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-07 10:56:00,798 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,798 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:00,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:00,799 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,799 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:56:00,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:00,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:00,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:00,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-07 10:56:00,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5046991b[Count = 0] remaining members to acquire global barrier 2023-03-07 10:56:00,800 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-07 10:56:00,800 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,801 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,801 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-07 10:56:00,801 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-07 10:56:00,801 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,801 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:56:00,801 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:56:00,802 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,802 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-07 10:56:00,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:00,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:00,802 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:00,803 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-07 10:56:00,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:00,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:00,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:00,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:56:00,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:56:00,804 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-07 10:56:00,804 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:56:00,805 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:56:00,805 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,805 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:56:00,811 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,811 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:00,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:00,812 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:00,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,812 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:00,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:00,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:00,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:00,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,813 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:00,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,815 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,815 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,815 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:00,815 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:00,815 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-07 10:56:00,815 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:00,815 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-07 10:56:00,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:00,815 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:00,816 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:56:00,815 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,816 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,816 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,816 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:00,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:00,816 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:56:00,816 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:56:00,916 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:56:00,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:56:00,922 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:56:00,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:56:00,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,923 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-07 10:56:00,923 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:00,923 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-07 10:56:00,923 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-07 10:56:00,924 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,924 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,925 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,925 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:00,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:00,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:00,925 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,925 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:56:00,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,926 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:56:00,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,926 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,926 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-07 10:56:00,926 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,926 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-07 10:56:00,927 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:00,927 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-07 10:56:00,927 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:56:00,927 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:56:00,927 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:56:00,927 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. started... 2023-03-07 10:56:00,927 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 120edd0de8d32c55588e2c2646d330b6 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-07 10:56:00,938 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128a2d6cbd20afe467e949e01597e4aa741 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128a2d6cbd20afe467e949e01597e4aa741 2023-03-07 10:56:00,942 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/.tmp/family1/9574aedc1caa47a799213f4bfd862cbe 2023-03-07 10:56:00,946 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/.tmp/family1/9574aedc1caa47a799213f4bfd862cbe as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/9574aedc1caa47a799213f4bfd862cbe 2023-03-07 10:56:00,952 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/9574aedc1caa47a799213f4bfd862cbe, entries=1, sequenceid=9, filesize=5.0 K 2023-03-07 10:56:00,953 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 120edd0de8d32c55588e2c2646d330b6 in 26ms, sequenceid=9, compaction requested=false 2023-03-07 10:56:00,953 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 120edd0de8d32c55588e2c2646d330b6: 2023-03-07 10:56:00,953 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:56:00,953 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:56:00,953 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:56:00,953 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,953 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-07 10:56:00,953 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-07 10:56:00,954 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,954 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:00,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:00,955 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,955 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:56:00,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:00,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:00,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:00,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-07 10:56:00,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e284be9[Count = 0] remaining members to acquire global barrier 2023-03-07 10:56:00,956 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-07 10:56:00,956 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,959 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,959 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,959 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:56:00,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,959 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-07 10:56:00,959 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-07 10:56:00,959 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:56:00,960 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,960 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-07 10:56:00,960 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:00,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,960 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-07 10:56:00,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:00,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:00,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:00,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:00,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:00,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:56:00,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:56:00,962 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-07 10:56:00,962 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:56:00,962 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:56:00,962 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,962 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:56:00,964 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,964 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:00,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:00,964 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:00,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,964 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:00,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:00,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:00,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:00,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,965 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:00,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,967 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,967 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,967 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:00,967 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:00,967 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-07 10:56:00,967 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:56:00,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:00,967 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:00,967 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:00,967 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:00,968 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,968 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:56:00,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:00,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:00,968 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:00,968 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:56:00,968 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,068 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:56:01,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:56:01,073 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:56:01,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:56:01,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,074 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-07 10:56:01,074 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:01,074 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-07 10:56:01,074 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-07 10:56:01,075 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,075 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,080 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:01,080 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:01,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:01,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:01,080 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:01,080 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:56:01,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:56:01,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,081 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,081 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-07 10:56:01,081 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,081 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-07 10:56:01,081 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:01,081 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-07 10:56:01,081 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:56:01,081 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:56:01,081 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:56:01,081 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. started... 2023-03-07 10:56:01,081 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 120edd0de8d32c55588e2c2646d330b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:56:01,491 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ca6fe0eef8574e3faaa694456fa7122a to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201ca6fe0eef8574e3faaa694456fa7122a 2023-03-07 10:56:01,896 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/.tmp/family1/311c7a07cf224dc095b15cb10c9fcc15 2023-03-07 10:56:01,900 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/.tmp/family1/311c7a07cf224dc095b15cb10c9fcc15 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/311c7a07cf224dc095b15cb10c9fcc15 2023-03-07 10:56:01,903 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/311c7a07cf224dc095b15cb10c9fcc15, entries=1, sequenceid=13, filesize=4.9 K 2023-03-07 10:56:01,904 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 120edd0de8d32c55588e2c2646d330b6 in 823ms, sequenceid=13, compaction requested=true 2023-03-07 10:56:01,904 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 120edd0de8d32c55588e2c2646d330b6: 2023-03-07 10:56:01,904 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:56:01,904 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:56:01,904 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:56:01,904 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:01,904 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-07 10:56:01,904 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-07 10:56:01,906 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,906 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:01,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:01,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:01,906 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,906 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:56:01,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:01,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:01,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:01,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:01,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:01,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-07 10:56:01,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6988563d[Count = 0] remaining members to acquire global barrier 2023-03-07 10:56:01,908 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-07 10:56:01,908 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,909 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,909 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-07 10:56:01,909 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-07 10:56:01,909 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:56:01,909 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:01,909 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:56:01,910 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-07 10:56:01,910 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:01,910 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:01,910 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-07 10:56:01,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:01,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:01,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:01,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:01,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:01,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:01,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:01,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:01,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:56:01,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:56:01,913 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-07 10:56:01,913 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:56:01,913 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:56:01,913 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,913 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:56:01,915 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,915 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:01,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:01,916 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:01,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:01,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:01,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:01,916 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:01,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:01,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,918 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:01,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:01,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:01,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:01,920 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:01,920 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:01,920 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:01,920 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:01,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:01,920 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-07 10:56:01,920 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:56:01,920 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,920 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:01,920 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:01,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:01,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:01,920 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:56:01,921 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:56:01,920 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,921 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:01,921 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,021 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:56:02,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:56:02,025 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:56:02,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:56:02,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,027 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-07 10:56:02,027 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:02,027 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-07 10:56:02,027 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-07 10:56:02,027 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,027 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,029 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:02,029 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:02,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:02,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:02,029 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:02,029 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:56:02,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,030 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:56:02,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,030 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,030 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-07 10:56:02,030 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,030 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-07 10:56:02,030 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:02,030 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-07 10:56:02,035 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:56:02,035 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:56:02,035 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:56:02,035 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. started... 2023-03-07 10:56:02,035 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 120edd0de8d32c55588e2c2646d330b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:56:02,446 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120549305ee5fc8744f4831a6b085664ff95 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120549305ee5fc8744f4831a6b085664ff95 2023-03-07 10:56:02,852 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/.tmp/family1/f1a326d998654135b314e2fc88efd29d 2023-03-07 10:56:02,855 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/.tmp/family1/f1a326d998654135b314e2fc88efd29d as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/f1a326d998654135b314e2fc88efd29d 2023-03-07 10:56:02,858 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/f1a326d998654135b314e2fc88efd29d, entries=1, sequenceid=17, filesize=4.9 K 2023-03-07 10:56:02,859 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 120edd0de8d32c55588e2c2646d330b6 in 824ms, sequenceid=17, compaction requested=true 2023-03-07 10:56:02,859 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 120edd0de8d32c55588e2c2646d330b6: 2023-03-07 10:56:02,859 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:56:02,859 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:56:02,859 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:56:02,859 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:02,859 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-07 10:56:02,859 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-07 10:56:02,861 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:02,861 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:02,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:02,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:02,861 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,861 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:56:02,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:02,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:02,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:02,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:02,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-07 10:56:02,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@396880e5[Count = 0] remaining members to acquire global barrier 2023-03-07 10:56:02,863 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-07 10:56:02,863 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,864 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,864 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-07 10:56:02,865 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-07 10:56:02,865 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:56:02,865 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:02,865 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:56:02,866 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:02,866 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-07 10:56:02,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:02,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:02,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:02,866 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:02,866 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-07 10:56:02,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:02,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:02,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:02,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:02,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:02,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:56:02,868 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:56:02,869 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-07 10:56:02,869 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:56:02,869 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:56:02,869 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,869 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:56:02,870 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,870 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:02,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:02,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,870 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:02,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:02,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:02,871 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:02,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:02,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:02,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,871 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:02,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:02,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:02,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:02,874 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:02,874 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:02,874 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:02,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:02,874 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:02,874 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-07 10:56:02,874 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:56:02,874 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,874 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:02,874 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,874 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,874 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:02,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:02,874 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:02,874 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:56:02,874 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:56:02,974 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:56:02,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:56:02,979 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:56:02,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:56:02,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,980 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-07 10:56:02,980 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:02,980 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-07 10:56:02,980 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-07 10:56:02,981 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,981 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,982 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:02,982 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:02,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:02,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:02,983 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:02,983 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:56:02,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:56:02,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,984 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,984 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-07 10:56:02,984 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:02,984 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-07 10:56:02,984 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:02,984 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-07 10:56:02,984 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:56:02,984 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:56:02,984 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:56:02,984 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. started... 2023-03-07 10:56:02,984 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 120edd0de8d32c55588e2c2646d330b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:56:03,395 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512286c7437d9a95b49beb78ad033489d4c0c to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512286c7437d9a95b49beb78ad033489d4c0c 2023-03-07 10:56:03,799 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/.tmp/family1/fdce738f8a0a48a097256ab2e994b258 2023-03-07 10:56:03,803 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/.tmp/family1/fdce738f8a0a48a097256ab2e994b258 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/fdce738f8a0a48a097256ab2e994b258 2023-03-07 10:56:03,806 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/fdce738f8a0a48a097256ab2e994b258, entries=1, sequenceid=21, filesize=4.9 K 2023-03-07 10:56:03,807 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 120edd0de8d32c55588e2c2646d330b6 in 823ms, sequenceid=21, compaction requested=true 2023-03-07 10:56:03,807 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 120edd0de8d32c55588e2c2646d330b6: 2023-03-07 10:56:03,807 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:56:03,807 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:56:03,807 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:56:03,807 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:03,807 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-07 10:56:03,807 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-07 10:56:03,809 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,809 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:03,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:03,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:03,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:03,809 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,809 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:56:03,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:03,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:03,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:03,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:03,810 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-07 10:56:03,810 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d825892[Count = 0] remaining members to acquire global barrier 2023-03-07 10:56:03,810 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-07 10:56:03,810 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,811 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,812 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-07 10:56:03,812 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-07 10:56:03,812 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:03,812 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:56:03,812 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:56:03,813 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:03,813 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-07 10:56:03,813 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:03,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:03,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:03,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:03,813 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-07 10:56:03,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:03,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:03,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:03,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:03,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:03,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:56:03,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:56:03,815 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-07 10:56:03,816 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:56:03,816 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:56:03,816 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,816 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:56:03,818 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,818 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:03,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:03,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,818 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:03,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:03,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:03,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:03,819 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:03,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:03,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:03,820 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:03,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:03,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:03,824 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:03,824 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:03,824 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:03,824 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,824 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:03,824 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,824 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:03,824 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-07 10:56:03,824 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:03,824 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,824 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-07 10:56:03,824 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:56:03,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:03,824 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,825 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:56:03,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:03,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:03,825 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:56:03,925 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:56:03,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:56:03,929 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:56:03,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:56:03,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,931 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-07 10:56:03,931 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:03,931 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-07 10:56:03,931 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-07 10:56:03,932 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,932 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,933 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:03,933 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:03,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:03,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:03,933 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:03,933 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:56:03,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,934 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:56:03,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,934 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,934 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-07 10:56:03,934 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:03,934 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-07 10:56:03,934 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:03,934 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-07 10:56:03,934 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:56:03,934 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:56:03,935 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:56:03,935 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. started... 2023-03-07 10:56:03,935 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 120edd0de8d32c55588e2c2646d330b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:56:04,347 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231abbe133602ee4a3d9f7195e42212e8f2 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231abbe133602ee4a3d9f7195e42212e8f2 2023-03-07 10:56:04,488 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-07 10:56:04,752 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/.tmp/family1/c53dcd4110164a68a0b5de01b3b5932b 2023-03-07 10:56:04,756 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/.tmp/family1/c53dcd4110164a68a0b5de01b3b5932b as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/c53dcd4110164a68a0b5de01b3b5932b 2023-03-07 10:56:04,760 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/c53dcd4110164a68a0b5de01b3b5932b, entries=1, sequenceid=25, filesize=4.9 K 2023-03-07 10:56:04,761 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 120edd0de8d32c55588e2c2646d330b6 in 826ms, sequenceid=25, compaction requested=true 2023-03-07 10:56:04,761 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 120edd0de8d32c55588e2c2646d330b6: 2023-03-07 10:56:04,761 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:56:04,761 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:56:04,761 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:56:04,761 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:04,761 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-07 10:56:04,761 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-07 10:56:04,763 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:04,763 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:04,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:04,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:04,763 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:04,763 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:56:04,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:04,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:04,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:04,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-07 10:56:04,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41e937c8[Count = 0] remaining members to acquire global barrier 2023-03-07 10:56:04,764 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-07 10:56:04,764 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,767 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,767 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-07 10:56:04,767 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-07 10:56:04,767 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:04,767 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:56:04,767 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:56:04,768 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-07 10:56:04,768 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:04,768 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:04,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:04,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:04,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:04,768 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-07 10:56:04,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:04,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:04,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:04,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:04,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:04,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:56:04,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:56:04,770 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-07 10:56:04,771 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:56:04,771 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:56:04,771 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,771 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:56:04,772 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,772 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,772 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:04,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:04,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:04,772 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:04,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:04,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:04,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:04,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:04,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,773 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:04,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:04,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:04,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:04,775 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:04,775 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,775 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:04,775 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,775 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:04,775 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-07 10:56:04,776 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:56:04,775 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:04,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:04,775 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:04,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:04,776 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,776 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,776 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,776 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:56:04,776 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:56:04,776 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-07 10:56:04,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:04,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:04,876 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:56:04,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:56:04,880 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:56:04,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:56:04,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,882 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-07 10:56:04,882 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:04,882 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-07 10:56:04,882 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-07 10:56:04,882 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,882 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,884 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:04,884 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:04,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:04,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:04,884 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:04,884 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:56:04,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,885 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:56:04,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,885 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,885 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-07 10:56:04,885 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:04,885 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-07 10:56:04,886 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:04,886 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-07 10:56:04,886 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:56:04,886 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:56:04,886 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:56:04,886 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. started... 2023-03-07 10:56:04,886 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 120edd0de8d32c55588e2c2646d330b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:56:05,297 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010177a40acc078e4f28a5e3d9358e039d43 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010177a40acc078e4f28a5e3d9358e039d43 2023-03-07 10:56:05,702 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/.tmp/family1/3acfce81544645ddbfb5d727f4cf3676 2023-03-07 10:56:05,706 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/.tmp/family1/3acfce81544645ddbfb5d727f4cf3676 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/3acfce81544645ddbfb5d727f4cf3676 2023-03-07 10:56:05,709 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/3acfce81544645ddbfb5d727f4cf3676, entries=1, sequenceid=29, filesize=4.9 K 2023-03-07 10:56:05,710 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 120edd0de8d32c55588e2c2646d330b6 in 824ms, sequenceid=29, compaction requested=true 2023-03-07 10:56:05,710 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 120edd0de8d32c55588e2c2646d330b6: 2023-03-07 10:56:05,710 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:56:05,710 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:56:05,710 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:56:05,710 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:05,710 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-07 10:56:05,710 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-07 10:56:05,711 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,711 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:05,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:05,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:05,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:05,712 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,712 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:56:05,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:05,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:05,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:05,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:05,713 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-07 10:56:05,713 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a7ba876[Count = 0] remaining members to acquire global barrier 2023-03-07 10:56:05,713 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-07 10:56:05,713 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,714 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,714 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-07 10:56:05,714 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-07 10:56:05,714 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:05,714 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:56:05,714 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:56:05,715 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:05,715 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-07 10:56:05,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:05,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:05,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:05,715 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:05,715 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-07 10:56:05,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:05,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:05,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:05,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:05,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:05,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:56:05,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:56:05,717 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-07 10:56:05,717 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:56:05,717 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:56:05,717 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,717 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:56:05,720 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,720 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,720 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:05,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:05,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:05,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:05,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:05,721 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:05,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:05,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:05,721 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:05,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:05,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:05,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,723 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:05,723 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,723 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:05,723 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-07 10:56:05,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:05,723 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:56:05,723 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:05,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-07 10:56:05,723 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:05,724 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:56:05,723 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,724 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:56:05,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:05,724 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:05,724 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,724 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,724 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:05,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:05,824 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:56:05,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:56:05,828 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:56:05,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:56:05,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,829 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-07 10:56:05,830 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:05,830 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-07 10:56:05,830 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-07 10:56:05,830 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,830 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,831 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:05,831 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:05,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:05,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:05,831 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:05,831 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:56:05,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,832 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:56:05,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,832 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,832 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-07 10:56:05,832 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:05,832 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-07 10:56:05,832 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:05,833 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-07 10:56:05,833 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:56:05,833 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:56:05,833 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:56:05,833 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. started... 2023-03-07 10:56:05,833 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 120edd0de8d32c55588e2c2646d330b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:56:06,243 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601032b587027f5e0475f870874fc80ad4ece to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601032b587027f5e0475f870874fc80ad4ece 2023-03-07 10:56:06,649 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/.tmp/family1/c0a853e74eda4cf2860a3a78059d33cb 2023-03-07 10:56:06,653 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/.tmp/family1/c0a853e74eda4cf2860a3a78059d33cb as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/c0a853e74eda4cf2860a3a78059d33cb 2023-03-07 10:56:06,655 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/c0a853e74eda4cf2860a3a78059d33cb, entries=1, sequenceid=33, filesize=4.9 K 2023-03-07 10:56:06,656 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 120edd0de8d32c55588e2c2646d330b6 in 823ms, sequenceid=33, compaction requested=true 2023-03-07 10:56:06,656 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 120edd0de8d32c55588e2c2646d330b6: 2023-03-07 10:56:06,656 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:56:06,656 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:56:06,656 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:56:06,656 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:06,656 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-07 10:56:06,656 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-07 10:56:06,658 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:06,658 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:06,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:06,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:06,658 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,658 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:56:06,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:06,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:06,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:06,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:06,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-07 10:56:06,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17e96274[Count = 0] remaining members to acquire global barrier 2023-03-07 10:56:06,659 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-07 10:56:06,660 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,661 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,661 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-07 10:56:06,661 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-07 10:56:06,661 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:56:06,661 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:06,661 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:56:06,663 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-07 10:56:06,663 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:06,663 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:06,663 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-07 10:56:06,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:06,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:06,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:06,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:06,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:06,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:06,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:06,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:06,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:56:06,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:56:06,665 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-07 10:56:06,665 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:56:06,665 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:56:06,665 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,665 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:56:06,669 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,669 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,669 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:06,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:06,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:06,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:06,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:06,669 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:06,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:06,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:06,670 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:06,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:06,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:06,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,672 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:06,672 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:06,672 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:06,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:06,672 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:06,672 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-07 10:56:06,672 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:56:06,672 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-07 10:56:06,672 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:06,672 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,672 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:06,672 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,672 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:56:06,672 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,673 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:56:06,673 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:06,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:06,773 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:56:06,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:56:06,777 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:56:06,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:56:06,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,778 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-07 10:56:06,778 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:06,778 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-07 10:56:06,778 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-07 10:56:06,779 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,779 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,780 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:06,780 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:06,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:06,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:06,780 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:06,780 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:56:06,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,781 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:56:06,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,781 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,781 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-07 10:56:06,782 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:06,782 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-07 10:56:06,782 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:06,782 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-07 10:56:06,782 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:56:06,782 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:56:06,782 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:56:06,782 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. started... 2023-03-07 10:56:06,782 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 120edd0de8d32c55588e2c2646d330b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:56:06,791 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090793b1f211f9004875ae8de31f078683ee to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015090793b1f211f9004875ae8de31f078683ee 2023-03-07 10:56:07,196 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/.tmp/family1/ec89e9f1abd849b1a9a60976ee8d3ba3 2023-03-07 10:56:07,199 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/.tmp/family1/ec89e9f1abd849b1a9a60976ee8d3ba3 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/ec89e9f1abd849b1a9a60976ee8d3ba3 2023-03-07 10:56:07,203 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/ec89e9f1abd849b1a9a60976ee8d3ba3, entries=1, sequenceid=37, filesize=4.9 K 2023-03-07 10:56:07,203 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 120edd0de8d32c55588e2c2646d330b6 in 421ms, sequenceid=37, compaction requested=true 2023-03-07 10:56:07,203 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 120edd0de8d32c55588e2c2646d330b6: 2023-03-07 10:56:07,203 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:56:07,204 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:56:07,204 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:56:07,204 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:07,204 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-07 10:56:07,204 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-07 10:56:07,205 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:07,205 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:07,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:07,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:07,206 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:07,206 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:56:07,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:07,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:07,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:07,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-07 10:56:07,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5860fed3[Count = 0] remaining members to acquire global barrier 2023-03-07 10:56:07,207 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-07 10:56:07,207 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,208 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,209 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-07 10:56:07,209 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-07 10:56:07,209 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:56:07,209 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:07,209 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:56:07,210 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-07 10:56:07,210 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:07,210 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:07,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:07,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:07,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:07,210 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-07 10:56:07,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:07,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:07,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:07,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:07,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:07,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:56:07,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:56:07,212 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-07 10:56:07,212 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:56:07,212 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:56:07,212 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,212 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:56:07,215 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,215 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:07,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:07,215 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:07,215 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:07,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:07,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:07,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:07,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:07,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,216 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:07,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:07,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:07,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:07,218 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:07,218 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,218 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:07,218 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-07 10:56:07,218 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:56:07,218 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:07,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:07,218 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:07,218 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:07,219 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:07,219 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:56:07,219 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:07,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:07,219 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:56:07,219 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,219 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,319 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:56:07,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:56:07,323 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:56:07,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-07 10:56:07,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,325 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-07 10:56:07,325 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:07,325 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-07 10:56:07,325 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-07 10:56:07,325 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,325 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,327 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:07,327 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:07,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:07,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:07,327 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:07,327 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:56:07,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,327 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:56:07,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,327 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,328 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-07 10:56:07,328 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:07,328 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-07 10:56:07,328 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:07,328 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-07 10:56:07,328 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-07 10:56:07,328 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:56:07,328 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:56:07,328 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. started... 2023-03-07 10:56:07,328 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 120edd0de8d32c55588e2c2646d330b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-07 10:56:07,739 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120a1f105ece4e94b1c845ebc487e1a1530 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120a1f105ece4e94b1c845ebc487e1a1530 2023-03-07 10:56:08,146 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/.tmp/family1/bff7c62829a94bdb84215d71c048f632 2023-03-07 10:56:08,150 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/.tmp/family1/bff7c62829a94bdb84215d71c048f632 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/bff7c62829a94bdb84215d71c048f632 2023-03-07 10:56:08,153 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/bff7c62829a94bdb84215d71c048f632, entries=1, sequenceid=41, filesize=4.9 K 2023-03-07 10:56:08,154 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 120edd0de8d32c55588e2c2646d330b6 in 826ms, sequenceid=41, compaction requested=true 2023-03-07 10:56:08,154 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 120edd0de8d32c55588e2c2646d330b6: 2023-03-07 10:56:08,154 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:56:08,154 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-07 10:56:08,154 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-07 10:56:08,154 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:08,154 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-07 10:56:08,154 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-07 10:56:08,156 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:08,156 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:08,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:08,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:08,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:08,156 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:08,156 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:56:08,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:08,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:08,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:08,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:08,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:08,157 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-07 10:56:08,157 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50bfd560[Count = 0] remaining members to acquire global barrier 2023-03-07 10:56:08,157 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-07 10:56:08,157 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:08,159 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:08,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:08,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:08,159 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-07 10:56:08,159 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-07 10:56:08,159 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:08,160 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:56:08,160 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:56:08,161 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:08,161 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-07 10:56:08,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:08,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:08,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:08,161 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:08,161 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-07 10:56:08,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:08,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:08,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:08,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:08,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:08,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:08,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:08,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:56:08,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-07 10:56:08,163 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-07 10:56:08,163 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:56:08,163 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:56:08,163 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:08,163 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:56:08,164 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:08,164 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:08,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:08,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:08,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:08,164 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:08,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:08,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:08,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:08,165 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:08,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:08,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:08,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:08,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:08,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:08,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:08,166 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:08,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:08,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:08,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:08,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:08,168 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:08,168 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:08,168 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:08,168 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:08,168 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:08,168 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:08,168 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-07 10:56:08,168 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-07 10:56:08,168 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:08,168 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:08,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:08,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:08,169 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:08,169 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:56:08,168 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:08,169 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-07 10:56:08,169 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:56:08,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:08,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:08,269 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:56:08,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:56:08,288 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45579] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-03-07 10:56:08,289 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-07 10:56:08,289 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-07 10:56:08,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:56:08,290 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678187168290 2023-03-07 10:56:08,291 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-07 10:56:08,291 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-03-07 10:56:08,291 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-07 10:56:08,292 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] zookeeper.ReadOnlyZKClient(139): Connect 0x1bdd3ed3 to 127.0.0.1:56055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-07 10:56:08,299 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e3595ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-07 10:56:08,299 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-07 10:56:08,724 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034e04fea1018e4290ab4de9d9b7179126 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601034e04fea1018e4290ab4de9d9b7179126 2023-03-07 10:56:08,725 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-07 10:56:08,737 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-07 10:56:08,740 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46822, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-07 10:56:08,745 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-07 10:56:08,746 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50298, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-07 10:56:08,753 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/40ef129109c64ebe8d67461c6597bf19 first=Optional[r5] last=Optional[r6] 2023-03-07 10:56:08,754 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/40ef129109c64ebe8d67461c6597bf19}] 2023-03-07 10:56:08,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/40ef129109c64ebe8d67461c6597bf19 for inclusion in 120edd0de8d32c55588e2c2646d330b6/family1 2023-03-07 10:56:08,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-03-07 10:56:08,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(777): Region bounds: first= last= 2023-03-07 10:56:08,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for 120edd0de8d32c55588e2c2646d330b6: 2023-03-07 10:56:08,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/40ef129109c64ebe8d67461c6597bf19 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__q0khm07545f6p3f0h6vfbsuf6pb20vf2iuo49d2994ldds7c41s2vrabniiset7f/family1/40ef129109c64ebe8d67461c6597bf19 2023-03-07 10:56:08,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__q0khm07545f6p3f0h6vfbsuf6pb20vf2iuo49d2994ldds7c41s2vrabniiset7f/family1/40ef129109c64ebe8d67461c6597bf19 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/cc698ced7d0146bdad0f4eee4fe76b13_SeqId_44_ 2023-03-07 10:56:08,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__q0khm07545f6p3f0h6vfbsuf6pb20vf2iuo49d2994ldds7c41s2vrabniiset7f/family1/40ef129109c64ebe8d67461c6597bf19 into 120edd0de8d32c55588e2c2646d330b6/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/cc698ced7d0146bdad0f4eee4fe76b13_SeqId_44_ - updating store file list. 2023-03-07 10:56:08,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/cc698ced7d0146bdad0f4eee4fe76b13_SeqId_44_ into 120edd0de8d32c55588e2c2646d330b6/family1 2023-03-07 10:56:08,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__q0khm07545f6p3f0h6vfbsuf6pb20vf2iuo49d2994ldds7c41s2vrabniiset7f/family1/40ef129109c64ebe8d67461c6597bf19 into 120edd0de8d32c55588e2c2646d330b6/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/cc698ced7d0146bdad0f4eee4fe76b13_SeqId_44_) 2023-03-07 10:56:08,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__q0khm07545f6p3f0h6vfbsuf6pb20vf2iuo49d2994ldds7c41s2vrabniiset7f/family1/40ef129109c64ebe8d67461c6597bf19 2023-03-07 10:56:08,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-07 10:56:08,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-07 10:56:08,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(1912): 120edd0de8d32c55588e2c2646d330b6/family1 is initiating minor compaction 2023-03-07 10:56:08,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5dc375e8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:56:08,772 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 120edd0de8d32c55588e2c2646d330b6/family1 in testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:56:08,772 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/9574aedc1caa47a799213f4bfd862cbe, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/311c7a07cf224dc095b15cb10c9fcc15, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/f1a326d998654135b314e2fc88efd29d, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/fdce738f8a0a48a097256ab2e994b258, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/c53dcd4110164a68a0b5de01b3b5932b, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/3acfce81544645ddbfb5d727f4cf3676, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/c0a853e74eda4cf2860a3a78059d33cb, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/ec89e9f1abd849b1a9a60976ee8d3ba3, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/bff7c62829a94bdb84215d71c048f632, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/cc698ced7d0146bdad0f4eee4fe76b13_SeqId_44_] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/.tmp, totalSize=49.7 K 2023-03-07 10:56:08,772 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 9574aedc1caa47a799213f4bfd862cbe, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-07 10:56:08,772 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 311c7a07cf224dc095b15cb10c9fcc15, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-07 10:56:08,772 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting f1a326d998654135b314e2fc88efd29d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-07 10:56:08,772 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting fdce738f8a0a48a097256ab2e994b258, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-07 10:56:08,772 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting c53dcd4110164a68a0b5de01b3b5932b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-07 10:56:08,772 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 3acfce81544645ddbfb5d727f4cf3676, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-07 10:56:08,772 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting c0a853e74eda4cf2860a3a78059d33cb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-07 10:56:08,772 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting ec89e9f1abd849b1a9a60976ee8d3ba3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-07 10:56:08,772 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting bff7c62829a94bdb84215d71c048f632, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-07 10:56:08,772 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting cc698ced7d0146bdad0f4eee4fe76b13_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-07 10:56:08,774 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-07 10:56:08,775 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:56:08,776 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010177a40acc078e4f28a5e3d9358e039d43 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010177a40acc078e4f28a5e3d9358e039d43 2023-03-07 10:56:08,777 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601032b587027f5e0475f870874fc80ad4ece to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601032b587027f5e0475f870874fc80ad4ece 2023-03-07 10:56:08,777 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-03-07 10:56:08,777 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-03-07 10:56:08,777 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-07 10:56:08,778 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-07 10:56:08,812 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] throttle.PressureAwareThroughputController(145): 120edd0de8d32c55588e2c2646d330b6#family1#compaction#166 average throughput is 0.46 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-03-07 10:56:09,628 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/.tmp/family1/415cd72750464ec4afd516a15798e46d as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/415cd72750464ec4afd516a15798e46d 2023-03-07 10:56:09,628 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512318a3f85a73fbd475bbe81e6651b583c91 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512318a3f85a73fbd475bbe81e6651b583c91 2023-03-07 10:56:09,629 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-07 10:56:09,632 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 120edd0de8d32c55588e2c2646d330b6/family1 of 120edd0de8d32c55588e2c2646d330b6 into 415cd72750464ec4afd516a15798e46d(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-07 10:56:09,632 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 120edd0de8d32c55588e2c2646d330b6: 2023-03-07 10:56:09,632 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1678186568771; duration=0sec 2023-03-07 10:56:09,632 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:56:09,652 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1b0b98d837434bf99967265253c17af5 first=Optional[r1] last=Optional[r4] 2023-03-07 10:56:09,653 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1b0b98d837434bf99967265253c17af5}] 2023-03-07 10:56:09,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1b0b98d837434bf99967265253c17af5 for inclusion in 120edd0de8d32c55588e2c2646d330b6/family1 2023-03-07 10:56:09,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-03-07 10:56:09,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(777): Region bounds: first= last= 2023-03-07 10:56:09,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for 120edd0de8d32c55588e2c2646d330b6: 2023-03-07 10:56:09,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1b0b98d837434bf99967265253c17af5 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2rilq44rrn7ar0ak9u6opuim0kc04mrggt1pttc1vv7lgpu9p3ga7mlros9p0t0p/family1/1b0b98d837434bf99967265253c17af5 2023-03-07 10:56:09,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2rilq44rrn7ar0ak9u6opuim0kc04mrggt1pttc1vv7lgpu9p3ga7mlros9p0t0p/family1/1b0b98d837434bf99967265253c17af5 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/d89e1e6f9412419c832174fbee626d8e_SeqId_47_ 2023-03-07 10:56:09,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2rilq44rrn7ar0ak9u6opuim0kc04mrggt1pttc1vv7lgpu9p3ga7mlros9p0t0p/family1/1b0b98d837434bf99967265253c17af5 into 120edd0de8d32c55588e2c2646d330b6/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/d89e1e6f9412419c832174fbee626d8e_SeqId_47_ - updating store file list. 2023-03-07 10:56:09,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/d89e1e6f9412419c832174fbee626d8e_SeqId_47_ into 120edd0de8d32c55588e2c2646d330b6/family1 2023-03-07 10:56:09,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2rilq44rrn7ar0ak9u6opuim0kc04mrggt1pttc1vv7lgpu9p3ga7mlros9p0t0p/family1/1b0b98d837434bf99967265253c17af5 into 120edd0de8d32c55588e2c2646d330b6/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/d89e1e6f9412419c832174fbee626d8e_SeqId_47_) 2023-03-07 10:56:09,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2rilq44rrn7ar0ak9u6opuim0kc04mrggt1pttc1vv7lgpu9p3ga7mlros9p0t0p/family1/1b0b98d837434bf99967265253c17af5 2023-03-07 10:56:09,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-07 10:56:09,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-07 10:56:09,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(1912): 120edd0de8d32c55588e2c2646d330b6/family1 is initiating minor compaction (all files) 2023-03-07 10:56:09,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5a323aed; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:56:09,667 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 120edd0de8d32c55588e2c2646d330b6/family1 in testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:56:09,667 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/49ff8365a13f4f7dbde7374597ead526, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/415cd72750464ec4afd516a15798e46d, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/d89e1e6f9412419c832174fbee626d8e_SeqId_47_] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/.tmp, totalSize=178.1 K 2023-03-07 10:56:09,667 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 49ff8365a13f4f7dbde7374597ead526, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878838856 2023-03-07 10:56:09,668 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting 415cd72750464ec4afd516a15798e46d, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621238856 2023-03-07 10:56:09,668 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] compactions.Compactor(207): Compacting d89e1e6f9412419c832174fbee626d8e_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965238856 2023-03-07 10:56:09,669 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-07 10:56:09,670 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:56:09,673 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201ca6fe0eef8574e3faaa694456fa7122a to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201ca6fe0eef8574e3faaa694456fa7122a 2023-03-07 10:56:09,674 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120549305ee5fc8744f4831a6b085664ff95 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120549305ee5fc8744f4831a6b085664ff95 2023-03-07 10:56:09,676 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512286c7437d9a95b49beb78ad033489d4c0c to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512286c7437d9a95b49beb78ad033489d4c0c 2023-03-07 10:56:09,678 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231abbe133602ee4a3d9f7195e42212e8f2 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231abbe133602ee4a3d9f7195e42212e8f2 2023-03-07 10:56:09,678 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-03-07 10:56:09,678 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-03-07 10:56:09,678 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-07 10:56:09,678 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-07 10:56:09,684 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] throttle.PressureAwareThroughputController(145): 120edd0de8d32c55588e2c2646d330b6#family1#compaction#167 average throughput is 25.93 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-03-07 10:56:09,688 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/9574aedc1caa47a799213f4bfd862cbe, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/311c7a07cf224dc095b15cb10c9fcc15, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/f1a326d998654135b314e2fc88efd29d, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/fdce738f8a0a48a097256ab2e994b258, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/c53dcd4110164a68a0b5de01b3b5932b, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/3acfce81544645ddbfb5d727f4cf3676, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/c0a853e74eda4cf2860a3a78059d33cb, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/ec89e9f1abd849b1a9a60976ee8d3ba3, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/bff7c62829a94bdb84215d71c048f632, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/cc698ced7d0146bdad0f4eee4fe76b13_SeqId_44_] to archive 2023-03-07 10:56:09,689 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:56:09,691 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/9574aedc1caa47a799213f4bfd862cbe to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/9574aedc1caa47a799213f4bfd862cbe 2023-03-07 10:56:09,692 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/311c7a07cf224dc095b15cb10c9fcc15 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/311c7a07cf224dc095b15cb10c9fcc15 2023-03-07 10:56:09,694 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/f1a326d998654135b314e2fc88efd29d to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/f1a326d998654135b314e2fc88efd29d 2023-03-07 10:56:09,695 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/fdce738f8a0a48a097256ab2e994b258 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/fdce738f8a0a48a097256ab2e994b258 2023-03-07 10:56:09,697 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/c53dcd4110164a68a0b5de01b3b5932b to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/c53dcd4110164a68a0b5de01b3b5932b 2023-03-07 10:56:09,698 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/3acfce81544645ddbfb5d727f4cf3676 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/3acfce81544645ddbfb5d727f4cf3676 2023-03-07 10:56:09,699 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/c0a853e74eda4cf2860a3a78059d33cb to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/c0a853e74eda4cf2860a3a78059d33cb 2023-03-07 10:56:09,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/ec89e9f1abd849b1a9a60976ee8d3ba3 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/ec89e9f1abd849b1a9a60976ee8d3ba3 2023-03-07 10:56:09,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/bff7c62829a94bdb84215d71c048f632 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/bff7c62829a94bdb84215d71c048f632 2023-03-07 10:56:09,702 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/cc698ced7d0146bdad0f4eee4fe76b13_SeqId_44_ to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/cc698ced7d0146bdad0f4eee4fe76b13_SeqId_44_ 2023-03-07 10:56:09,746 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113086077187afcf4d019ebf0f0525375cea to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113086077187afcf4d019ebf0f0525375cea 2023-03-07 10:56:09,746 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-07 10:56:09,769 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d20e869569414e3c92f70a7b98678aa7 first=Optional[r00] last=Optional[r8] 2023-03-07 10:56:09,770 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d20e869569414e3c92f70a7b98678aa7}] 2023-03-07 10:56:09,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d20e869569414e3c92f70a7b98678aa7 for inclusion in 120edd0de8d32c55588e2c2646d330b6/family1 2023-03-07 10:56:09,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-03-07 10:56:09,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(777): Region bounds: first= last= 2023-03-07 10:56:09,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for 120edd0de8d32c55588e2c2646d330b6: 2023-03-07 10:56:09,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d20e869569414e3c92f70a7b98678aa7 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2pbpthten9bu9b22blouo8jjtsf9utqjm2f0nsvnft6judc8gjhh2c32s39nkp8g/family1/d20e869569414e3c92f70a7b98678aa7 2023-03-07 10:56:09,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2pbpthten9bu9b22blouo8jjtsf9utqjm2f0nsvnft6judc8gjhh2c32s39nkp8g/family1/d20e869569414e3c92f70a7b98678aa7 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/8f9c243ec09a4171a33b394bb4d7e248_SeqId_49_ 2023-03-07 10:56:09,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2pbpthten9bu9b22blouo8jjtsf9utqjm2f0nsvnft6judc8gjhh2c32s39nkp8g/family1/d20e869569414e3c92f70a7b98678aa7 into 120edd0de8d32c55588e2c2646d330b6/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/8f9c243ec09a4171a33b394bb4d7e248_SeqId_49_ - updating store file list. 2023-03-07 10:56:09,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/8f9c243ec09a4171a33b394bb4d7e248_SeqId_49_ into 120edd0de8d32c55588e2c2646d330b6/family1 2023-03-07 10:56:09,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2pbpthten9bu9b22blouo8jjtsf9utqjm2f0nsvnft6judc8gjhh2c32s39nkp8g/family1/d20e869569414e3c92f70a7b98678aa7 into 120edd0de8d32c55588e2c2646d330b6/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/8f9c243ec09a4171a33b394bb4d7e248_SeqId_49_) 2023-03-07 10:56:09,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2pbpthten9bu9b22blouo8jjtsf9utqjm2f0nsvnft6judc8gjhh2c32s39nkp8g/family1/d20e869569414e3c92f70a7b98678aa7 2023-03-07 10:56:09,782 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-07 10:56:09,783 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:56:09,784 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120a1f105ece4e94b1c845ebc487e1a1530 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120a1f105ece4e94b1c845ebc487e1a1530 2023-03-07 10:56:09,785 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128a2d6cbd20afe467e949e01597e4aa741 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128a2d6cbd20afe467e949e01597e4aa741 2023-03-07 10:56:09,786 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130a47d6c3bc5e74f408b35f7401111ceba to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130a47d6c3bc5e74f408b35f7401111ceba 2023-03-07 10:56:09,786 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-03-07 10:56:09,786 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-07 10:56:09,786 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-07 10:56:09,787 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-07 10:56:09,787 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-07 10:56:09,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-07 10:56:09,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:56:09,789 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-07 10:56:09,790 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.5010 sec 2023-03-07 10:56:09,993 INFO [Listener at localhost/42383] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=258 (was 253) - Thread LEAK? -, OpenFileDescriptor=649 (was 633) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=182 (was 169) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=9339 (was 9349) 2023-03-07 10:56:10,006 INFO [Listener at localhost/42383] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=258, OpenFileDescriptor=649, MaxFileDescriptor=60000, SystemLoadAverage=182, ProcessCount=171, AvailableMemoryMB=9339 2023-03-07 10:56:10,032 DEBUG [Listener at localhost/42383] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-03-07 10:56:10,087 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x888f\x0A\xCB\xC2\xA5\xA2\xED\x97o:\x0B\x11\xAFD"\x10s C\xC9\xD5{{\x0C\xD2Q=|\x8F\xFF\xA5\xEC*\x10+\xC3\xDC\x88\x1A\x94\x8DX\xE5nl4\xC4]C\x1F2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-07 10:56:10,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-03-07 10:56:10,089 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-03-07 10:56:10,089 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-03-07 10:56:10,090 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-07 10:56:10,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-07 10:56:10,092 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6 2023-03-07 10:56:10,092 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2 2023-03-07 10:56:10,092 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44 2023-03-07 10:56:10,092 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2 empty. 2023-03-07 10:56:10,092 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44 empty. 2023-03-07 10:56:10,092 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6 empty. 2023-03-07 10:56:10,093 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2 2023-03-07 10:56:10,093 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6 2023-03-07 10:56:10,093 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44 2023-03-07 10:56:10,093 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-03-07 10:56:10,102 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-03-07 10:56:10,103 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => e3ae8109578fdd9db32b92d5f9c631b6, NAME => 'testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x888f\x0A\xCB\xC2\xA5\xA2\xED\x97o:\x0B\x11\xAFD"\x10s C\xC9\xD5{{\x0C\xD2Q=|\x8F\xFF\xA5\xEC*\x10+\xC3\xDC\x88\x1A\x94\x8DX\xE5nl4\xC4]C\x1F2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp 2023-03-07 10:56:10,107 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0d5f3df3acacfb99246262b2f6eba2c2, NAME => 'testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x888f\x0A\xCB\xC2\xA5\xA2\xED\x97o:\x0B\x11\xAFD"\x10s C\xC9\xD5{{\x0C\xD2Q=|\x8F\xFF\xA5\xEC*\x10+\xC3\xDC\x88\x1A\x94\x8DX\xE5nl4\xC4]C\x1F2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp 2023-03-07 10:56:10,107 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => c27a6080404dc0d00435f95e017c7c44, NAME => 'testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x888f\x0A\xCB\xC2\xA5\xA2\xED\x97o:\x0B\x11\xAFD"\x10s C\xC9\xD5{{\x0C\xD2Q=|\x8F\xFF\xA5\xEC*\x10+\xC3\xDC\x88\x1A\x94\x8DX\xE5nl4\xC4]C\x1F2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/.tmp 2023-03-07 10:56:10,132 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/.tmp/family1/1e28e18da4854b869ac162b7bd3de737 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/1e28e18da4854b869ac162b7bd3de737 2023-03-07 10:56:10,135 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 120edd0de8d32c55588e2c2646d330b6/family1 of 120edd0de8d32c55588e2c2646d330b6 into 1e28e18da4854b869ac162b7bd3de737(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-07 10:56:10,135 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 120edd0de8d32c55588e2c2646d330b6: 2023-03-07 10:56:10,135 INFO [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1678186569667; duration=0sec 2023-03-07 10:56:10,136 DEBUG [RS:0;jenkins-hbase4:39673-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-07 10:56:10,179 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/49ff8365a13f4f7dbde7374597ead526, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/415cd72750464ec4afd516a15798e46d, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/d89e1e6f9412419c832174fbee626d8e_SeqId_47_] to archive 2023-03-07 10:56:10,180 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:56:10,182 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/49ff8365a13f4f7dbde7374597ead526 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/49ff8365a13f4f7dbde7374597ead526 2023-03-07 10:56:10,183 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/415cd72750464ec4afd516a15798e46d to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/415cd72750464ec4afd516a15798e46d 2023-03-07 10:56:10,184 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/d89e1e6f9412419c832174fbee626d8e_SeqId_47_ to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/family1/d89e1e6f9412419c832174fbee626d8e_SeqId_47_ 2023-03-07 10:56:10,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-07 10:56:10,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-07 10:56:10,517 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:56:10,518 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing e3ae8109578fdd9db32b92d5f9c631b6, disabling compactions & flushes 2023-03-07 10:56:10,518 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. 2023-03-07 10:56:10,518 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. 2023-03-07 10:56:10,518 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. after waiting 0 ms 2023-03-07 10:56:10,518 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. 2023-03-07 10:56:10,518 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. 2023-03-07 10:56:10,518 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for e3ae8109578fdd9db32b92d5f9c631b6: 2023-03-07 10:56:10,522 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:56:10,522 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:56:10,522 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 0d5f3df3acacfb99246262b2f6eba2c2, disabling compactions & flushes 2023-03-07 10:56:10,522 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing c27a6080404dc0d00435f95e017c7c44, disabling compactions & flushes 2023-03-07 10:56:10,522 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. 2023-03-07 10:56:10,522 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. 2023-03-07 10:56:10,522 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. 2023-03-07 10:56:10,522 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. after waiting 0 ms 2023-03-07 10:56:10,522 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. 2023-03-07 10:56:10,522 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. 2023-03-07 10:56:10,522 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. 2023-03-07 10:56:10,522 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 0d5f3df3acacfb99246262b2f6eba2c2: 2023-03-07 10:56:10,522 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. after waiting 0 ms 2023-03-07 10:56:10,522 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. 2023-03-07 10:56:10,522 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. 2023-03-07 10:56:10,522 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for c27a6080404dc0d00435f95e017c7c44: 2023-03-07 10:56:10,524 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-03-07 10:56:10,525 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678186570525"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186570525"}]},"ts":"1678186570525"} 2023-03-07 10:56:10,525 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1678186570525"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186570525"}]},"ts":"1678186570525"} 2023-03-07 10:56:10,525 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678186570525"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678186570525"}]},"ts":"1678186570525"} 2023-03-07 10:56:10,526 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-07 10:56:10,527 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-07 10:56:10,527 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186570527"}]},"ts":"1678186570527"} 2023-03-07 10:56:10,528 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-03-07 10:56:10,532 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e3ae8109578fdd9db32b92d5f9c631b6, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0d5f3df3acacfb99246262b2f6eba2c2, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=c27a6080404dc0d00435f95e017c7c44, ASSIGN}] 2023-03-07 10:56:10,534 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=c27a6080404dc0d00435f95e017c7c44, ASSIGN 2023-03-07 10:56:10,534 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0d5f3df3acacfb99246262b2f6eba2c2, ASSIGN 2023-03-07 10:56:10,534 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e3ae8109578fdd9db32b92d5f9c631b6, ASSIGN 2023-03-07 10:56:10,535 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=c27a6080404dc0d00435f95e017c7c44, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39673,1678186416064; forceNewPlan=false, retain=false 2023-03-07 10:56:10,535 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0d5f3df3acacfb99246262b2f6eba2c2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39673,1678186416064; forceNewPlan=false, retain=false 2023-03-07 10:56:10,535 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e3ae8109578fdd9db32b92d5f9c631b6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39673,1678186416064; forceNewPlan=false, retain=false 2023-03-07 10:56:10,686 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=c27a6080404dc0d00435f95e017c7c44, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:10,686 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=e3ae8109578fdd9db32b92d5f9c631b6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:10,686 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=0d5f3df3acacfb99246262b2f6eba2c2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:10,687 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678186570686"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186570686"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186570686"}]},"ts":"1678186570686"} 2023-03-07 10:56:10,687 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678186570686"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186570686"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186570686"}]},"ts":"1678186570686"} 2023-03-07 10:56:10,687 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1678186570686"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678186570686"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678186570686"}]},"ts":"1678186570686"} 2023-03-07 10:56:10,688 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=119, state=RUNNABLE; OpenRegionProcedure c27a6080404dc0d00435f95e017c7c44, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:56:10,689 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=117, state=RUNNABLE; OpenRegionProcedure e3ae8109578fdd9db32b92d5f9c631b6, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:56:10,689 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=118, state=RUNNABLE; OpenRegionProcedure 0d5f3df3acacfb99246262b2f6eba2c2, server=jenkins-hbase4.apache.org,39673,1678186416064}] 2023-03-07 10:56:10,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-07 10:56:10,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. 2023-03-07 10:56:10,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e3ae8109578fdd9db32b92d5f9c631b6, NAME => 'testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6.', STARTKEY => '', ENDKEY => '1'} 2023-03-07 10:56:10,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin e3ae8109578fdd9db32b92d5f9c631b6 2023-03-07 10:56:10,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:56:10,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e3ae8109578fdd9db32b92d5f9c631b6 2023-03-07 10:56:10,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e3ae8109578fdd9db32b92d5f9c631b6 2023-03-07 10:56:10,864 INFO [StoreOpener-e3ae8109578fdd9db32b92d5f9c631b6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e3ae8109578fdd9db32b92d5f9c631b6 2023-03-07 10:56:10,865 DEBUG [StoreOpener-e3ae8109578fdd9db32b92d5f9c631b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1 2023-03-07 10:56:10,865 DEBUG [StoreOpener-e3ae8109578fdd9db32b92d5f9c631b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1 2023-03-07 10:56:10,865 INFO [StoreOpener-e3ae8109578fdd9db32b92d5f9c631b6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e3ae8109578fdd9db32b92d5f9c631b6 columnFamilyName family1 2023-03-07 10:56:10,867 INFO [StoreOpener-e3ae8109578fdd9db32b92d5f9c631b6-1] regionserver.HStore(310): Store=e3ae8109578fdd9db32b92d5f9c631b6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:56:10,867 INFO [StoreOpener-e3ae8109578fdd9db32b92d5f9c631b6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e3ae8109578fdd9db32b92d5f9c631b6 2023-03-07 10:56:10,868 DEBUG [StoreOpener-e3ae8109578fdd9db32b92d5f9c631b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2 2023-03-07 10:56:10,868 DEBUG [StoreOpener-e3ae8109578fdd9db32b92d5f9c631b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2 2023-03-07 10:56:10,868 INFO [StoreOpener-e3ae8109578fdd9db32b92d5f9c631b6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e3ae8109578fdd9db32b92d5f9c631b6 columnFamilyName family2 2023-03-07 10:56:10,869 INFO [StoreOpener-e3ae8109578fdd9db32b92d5f9c631b6-1] regionserver.HStore(310): Store=e3ae8109578fdd9db32b92d5f9c631b6/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:56:10,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6 2023-03-07 10:56:10,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6 2023-03-07 10:56:10,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-07 10:56:10,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e3ae8109578fdd9db32b92d5f9c631b6 2023-03-07 10:56:10,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-07 10:56:10,874 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e3ae8109578fdd9db32b92d5f9c631b6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67060973, jitterRate=-7.136315107345581E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-07 10:56:10,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e3ae8109578fdd9db32b92d5f9c631b6: 2023-03-07 10:56:10,874 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6., pid=121, masterSystemTime=1678186570840 2023-03-07 10:56:10,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. 2023-03-07 10:56:10,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. 2023-03-07 10:56:10,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. 2023-03-07 10:56:10,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c27a6080404dc0d00435f95e017c7c44, NAME => 'testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44.', STARTKEY => '2', ENDKEY => ''} 2023-03-07 10:56:10,876 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=e3ae8109578fdd9db32b92d5f9c631b6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:10,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin c27a6080404dc0d00435f95e017c7c44 2023-03-07 10:56:10,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:56:10,876 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678186570876"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186570876"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186570876"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186570876"}]},"ts":"1678186570876"} 2023-03-07 10:56:10,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c27a6080404dc0d00435f95e017c7c44 2023-03-07 10:56:10,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c27a6080404dc0d00435f95e017c7c44 2023-03-07 10:56:10,879 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=117 2023-03-07 10:56:10,879 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=117, state=SUCCESS; OpenRegionProcedure e3ae8109578fdd9db32b92d5f9c631b6, server=jenkins-hbase4.apache.org,39673,1678186416064 in 188 msec 2023-03-07 10:56:10,879 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e3ae8109578fdd9db32b92d5f9c631b6, ASSIGN in 347 msec 2023-03-07 10:56:10,897 INFO [StoreOpener-c27a6080404dc0d00435f95e017c7c44-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c27a6080404dc0d00435f95e017c7c44 2023-03-07 10:56:10,898 DEBUG [StoreOpener-c27a6080404dc0d00435f95e017c7c44-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1 2023-03-07 10:56:10,898 DEBUG [StoreOpener-c27a6080404dc0d00435f95e017c7c44-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1 2023-03-07 10:56:10,898 INFO [StoreOpener-c27a6080404dc0d00435f95e017c7c44-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c27a6080404dc0d00435f95e017c7c44 columnFamilyName family1 2023-03-07 10:56:10,899 INFO [StoreOpener-c27a6080404dc0d00435f95e017c7c44-1] regionserver.HStore(310): Store=c27a6080404dc0d00435f95e017c7c44/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:56:10,899 INFO [StoreOpener-c27a6080404dc0d00435f95e017c7c44-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c27a6080404dc0d00435f95e017c7c44 2023-03-07 10:56:10,900 DEBUG [StoreOpener-c27a6080404dc0d00435f95e017c7c44-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2 2023-03-07 10:56:10,900 DEBUG [StoreOpener-c27a6080404dc0d00435f95e017c7c44-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2 2023-03-07 10:56:10,900 INFO [StoreOpener-c27a6080404dc0d00435f95e017c7c44-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c27a6080404dc0d00435f95e017c7c44 columnFamilyName family2 2023-03-07 10:56:10,901 INFO [StoreOpener-c27a6080404dc0d00435f95e017c7c44-1] regionserver.HStore(310): Store=c27a6080404dc0d00435f95e017c7c44/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:56:10,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44 2023-03-07 10:56:10,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44 2023-03-07 10:56:10,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-07 10:56:10,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c27a6080404dc0d00435f95e017c7c44 2023-03-07 10:56:10,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-07 10:56:10,905 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c27a6080404dc0d00435f95e017c7c44; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69907241, jitterRate=0.04169906675815582}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-07 10:56:10,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c27a6080404dc0d00435f95e017c7c44: 2023-03-07 10:56:10,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44., pid=120, masterSystemTime=1678186570840 2023-03-07 10:56:10,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. 2023-03-07 10:56:10,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. 2023-03-07 10:56:10,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. 2023-03-07 10:56:10,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0d5f3df3acacfb99246262b2f6eba2c2, NAME => 'testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2.', STARTKEY => '1', ENDKEY => '2'} 2023-03-07 10:56:10,907 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=c27a6080404dc0d00435f95e017c7c44, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:10,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 0d5f3df3acacfb99246262b2f6eba2c2 2023-03-07 10:56:10,907 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678186570907"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186570907"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186570907"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186570907"}]},"ts":"1678186570907"} 2023-03-07 10:56:10,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-07 10:56:10,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0d5f3df3acacfb99246262b2f6eba2c2 2023-03-07 10:56:10,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0d5f3df3acacfb99246262b2f6eba2c2 2023-03-07 10:56:10,910 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=119 2023-03-07 10:56:10,910 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=119, state=SUCCESS; OpenRegionProcedure c27a6080404dc0d00435f95e017c7c44, server=jenkins-hbase4.apache.org,39673,1678186416064 in 221 msec 2023-03-07 10:56:10,910 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=c27a6080404dc0d00435f95e017c7c44, ASSIGN in 378 msec 2023-03-07 10:56:10,931 INFO [StoreOpener-0d5f3df3acacfb99246262b2f6eba2c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0d5f3df3acacfb99246262b2f6eba2c2 2023-03-07 10:56:10,932 DEBUG [StoreOpener-0d5f3df3acacfb99246262b2f6eba2c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1 2023-03-07 10:56:10,933 DEBUG [StoreOpener-0d5f3df3acacfb99246262b2f6eba2c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1 2023-03-07 10:56:10,933 INFO [StoreOpener-0d5f3df3acacfb99246262b2f6eba2c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d5f3df3acacfb99246262b2f6eba2c2 columnFamilyName family1 2023-03-07 10:56:10,934 INFO [StoreOpener-0d5f3df3acacfb99246262b2f6eba2c2-1] regionserver.HStore(310): Store=0d5f3df3acacfb99246262b2f6eba2c2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:56:10,934 INFO [StoreOpener-0d5f3df3acacfb99246262b2f6eba2c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0d5f3df3acacfb99246262b2f6eba2c2 2023-03-07 10:56:10,935 DEBUG [StoreOpener-0d5f3df3acacfb99246262b2f6eba2c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2 2023-03-07 10:56:10,935 DEBUG [StoreOpener-0d5f3df3acacfb99246262b2f6eba2c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2 2023-03-07 10:56:10,935 INFO [StoreOpener-0d5f3df3acacfb99246262b2f6eba2c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d5f3df3acacfb99246262b2f6eba2c2 columnFamilyName family2 2023-03-07 10:56:10,936 INFO [StoreOpener-0d5f3df3acacfb99246262b2f6eba2c2-1] regionserver.HStore(310): Store=0d5f3df3acacfb99246262b2f6eba2c2/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-07 10:56:10,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2 2023-03-07 10:56:10,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2 2023-03-07 10:56:10,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-07 10:56:10,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0d5f3df3acacfb99246262b2f6eba2c2 2023-03-07 10:56:10,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-07 10:56:10,941 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0d5f3df3acacfb99246262b2f6eba2c2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70507510, jitterRate=0.05064377188682556}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-07 10:56:10,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0d5f3df3acacfb99246262b2f6eba2c2: 2023-03-07 10:56:10,941 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2., pid=122, masterSystemTime=1678186570840 2023-03-07 10:56:10,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. 2023-03-07 10:56:10,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. 2023-03-07 10:56:10,943 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=0d5f3df3acacfb99246262b2f6eba2c2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:10,943 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1678186570942"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678186570942"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678186570942"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678186570942"}]},"ts":"1678186570942"} 2023-03-07 10:56:10,945 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=118 2023-03-07 10:56:10,945 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=118, state=SUCCESS; OpenRegionProcedure 0d5f3df3acacfb99246262b2f6eba2c2, server=jenkins-hbase4.apache.org,39673,1678186416064 in 255 msec 2023-03-07 10:56:10,946 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-03-07 10:56:10,946 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0d5f3df3acacfb99246262b2f6eba2c2, ASSIGN in 413 msec 2023-03-07 10:56:10,946 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-07 10:56:10,946 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678186570946"}]},"ts":"1678186570946"} 2023-03-07 10:56:10,947 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-03-07 10:56:10,949 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-03-07 10:56:10,950 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 862 msec 2023-03-07 10:56:11,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-07 10:56:11,194 INFO [Listener at localhost/42383] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-03-07 10:56:11,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:56:11,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:56:11,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:56:11,202 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:56:11,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-07 10:56:11,205 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-07 10:56:11,205 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:11,205 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-07 10:56:11,205 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-07 10:56:11,206 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:11,206 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-07 10:56:11,210 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:11,210 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:11,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:11,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:11,210 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:11,210 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:56:11,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-07 10:56:11,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:11,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:56:11,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-07 10:56:11,211 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-07 10:56:11,211 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-07 10:56:11,211 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-07 10:56:11,211 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:11,211 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-07 10:56:11,211 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. 2023-03-07 10:56:11,211 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. started... 2023-03-07 10:56:11,211 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. 2023-03-07 10:56:11,211 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. started... 2023-03-07 10:56:11,212 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c27a6080404dc0d00435f95e017c7c44 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-07 10:56:11,212 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. 2023-03-07 10:56:11,212 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-07 10:56:11,213 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. started... 2023-03-07 10:56:11,213 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:56:11,213 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0d5f3df3acacfb99246262b2f6eba2c2 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-07 10:56:11,213 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e3ae8109578fdd9db32b92d5f9c631b6 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-07 10:56:11,266 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303071322f576bb234faf8db04d38b4176181 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303071322f576bb234faf8db04d38b4176181 2023-03-07 10:56:11,662 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303071b2944f7c40540088b6b46f23ebd86f7 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303071b2944f7c40540088b6b46f23ebd86f7 2023-03-07 10:56:11,676 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230307d7a690305bd047e887e0c9020ffb45f0 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230307d7a690305bd047e887e0c9020ffb45f0 2023-03-07 10:56:11,682 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/.tmp/family1/f2635941ab044dfc83b5623067b68c8d 2023-03-07 10:56:12,076 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/.tmp/family1/ae8bafa1fa86480683b1452505bf961e 2023-03-07 10:56:12,093 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/.tmp/family1/71f1e22b5b0940a1a52d4bc80e9173c8 2023-03-07 10:56:12,116 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303073444473c9ce94dc6b3a5b26961984002 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202303073444473c9ce94dc6b3a5b26961984002 2023-03-07 10:56:12,511 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230307acfc907b7b3744979f01a32d1546f583 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230307acfc907b7b3744979f01a32d1546f583 2023-03-07 10:56:12,525 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/.tmp/family2/2e4f44640cc54d7db64e7a5d9ddd5804 2023-03-07 10:56:12,528 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303075ac3599cdfa54c7da46b590b78d80fbd to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202303075ac3599cdfa54c7da46b590b78d80fbd 2023-03-07 10:56:12,529 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/.tmp/family1/f2635941ab044dfc83b5623067b68c8d as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/f2635941ab044dfc83b5623067b68c8d 2023-03-07 10:56:12,555 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/f2635941ab044dfc83b5623067b68c8d, entries=4, sequenceid=5, filesize=5.5 K 2023-03-07 10:56:12,556 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/.tmp/family2/2e4f44640cc54d7db64e7a5d9ddd5804 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/2e4f44640cc54d7db64e7a5d9ddd5804 2023-03-07 10:56:12,559 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/2e4f44640cc54d7db64e7a5d9ddd5804, entries=2, sequenceid=5, filesize=5.1 K 2023-03-07 10:56:12,560 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 0d5f3df3acacfb99246262b2f6eba2c2 in 1347ms, sequenceid=5, compaction requested=false 2023-03-07 10:56:12,560 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-03-07 10:56:12,560 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0d5f3df3acacfb99246262b2f6eba2c2: 2023-03-07 10:56:12,561 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. 2023-03-07 10:56:12,561 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-07 10:56:12,916 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/.tmp/family2/ab5e45f7cf99442ab017c41c9d20c45a 2023-03-07 10:56:12,920 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/.tmp/family1/ae8bafa1fa86480683b1452505bf961e as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/ae8bafa1fa86480683b1452505bf961e 2023-03-07 10:56:12,933 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/.tmp/family2/bb6e82612db843dfb5f993f34c5d68f0 2023-03-07 10:56:12,937 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/.tmp/family1/71f1e22b5b0940a1a52d4bc80e9173c8 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/71f1e22b5b0940a1a52d4bc80e9173c8 2023-03-07 10:56:12,947 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/ae8bafa1fa86480683b1452505bf961e, entries=4, sequenceid=5, filesize=5.5 K 2023-03-07 10:56:12,948 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/.tmp/family2/ab5e45f7cf99442ab017c41c9d20c45a as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/ab5e45f7cf99442ab017c41c9d20c45a 2023-03-07 10:56:12,951 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/ab5e45f7cf99442ab017c41c9d20c45a, entries=2, sequenceid=5, filesize=5.1 K 2023-03-07 10:56:12,952 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for e3ae8109578fdd9db32b92d5f9c631b6 in 1739ms, sequenceid=5, compaction requested=false 2023-03-07 10:56:12,953 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e3ae8109578fdd9db32b92d5f9c631b6: 2023-03-07 10:56:12,953 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. 2023-03-07 10:56:12,953 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-07 10:56:12,963 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/71f1e22b5b0940a1a52d4bc80e9173c8, entries=4, sequenceid=5, filesize=5.5 K 2023-03-07 10:56:12,963 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/.tmp/family2/bb6e82612db843dfb5f993f34c5d68f0 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/bb6e82612db843dfb5f993f34c5d68f0 2023-03-07 10:56:12,966 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/bb6e82612db843dfb5f993f34c5d68f0, entries=2, sequenceid=5, filesize=5.1 K 2023-03-07 10:56:12,967 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for c27a6080404dc0d00435f95e017c7c44 in 1755ms, sequenceid=5, compaction requested=false 2023-03-07 10:56:12,967 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c27a6080404dc0d00435f95e017c7c44: 2023-03-07 10:56:12,967 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. 2023-03-07 10:56:12,967 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-07 10:56:12,967 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-07 10:56:12,967 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:12,967 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-07 10:56:12,967 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-07 10:56:12,969 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:12,969 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:12,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:12,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:12,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:12,969 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:12,969 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:56:12,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:12,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:12,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:12,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:12,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:12,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-07 10:56:12,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6730ef19[Count = 0] remaining members to acquire global barrier 2023-03-07 10:56:12,970 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-07 10:56:12,970 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:12,971 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:12,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:12,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:12,972 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:12,972 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:56:12,972 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-07 10:56:12,972 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-07 10:56:12,972 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:56:12,974 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:12,974 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-07 10:56:12,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:12,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:12,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:12,974 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:12,974 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-07 10:56:12,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:12,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:12,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:12,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:12,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:12,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:12,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:12,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:56:12,976 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-07 10:56:12,976 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-07 10:56:12,976 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:56:12,976 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:56:12,976 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-07 10:56:12,976 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:56:12,977 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:12,978 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:12,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:12,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:12,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:12,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:12,978 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:12,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:12,978 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:12,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:12,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:12,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:12,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:12,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:12,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:12,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:12,979 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:12,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:12,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:12,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:12,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:12,981 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:12,981 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:12,981 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-07 10:56:12,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:12,981 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-07 10:56:12,981 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-07 10:56:12,981 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:12,981 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:56:12,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:12,981 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:12,981 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-07 10:56:12,981 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:12,981 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:12,981 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:12,981 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:12,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:12,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:12,981 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-07 10:56:12,982 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:56:13,082 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:56:13,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:56:13,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:56:13,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:56:13,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:56:13,086 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:56:13,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-07 10:56:13,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-07 10:56:13,088 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-07 10:56:13,088 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:13,088 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-07 10:56:13,088 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-07 10:56:13,088 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:13,088 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-07 10:56:13,089 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:13,089 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:13,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:13,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:13,090 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:13,090 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:56:13,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-07 10:56:13,090 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:13,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:56:13,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-07 10:56:13,090 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-07 10:56:13,090 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-07 10:56:13,091 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-07 10:56:13,091 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-07 10:56:13,091 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:13,091 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-07 10:56:13,091 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. 2023-03-07 10:56:13,091 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-07 10:56:13,091 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. 2023-03-07 10:56:13,091 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. 2023-03-07 10:56:13,091 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. started... 2023-03-07 10:56:13,091 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. started... 2023-03-07 10:56:13,091 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:56:13,091 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. started... 2023-03-07 10:56:13,091 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0d5f3df3acacfb99246262b2f6eba2c2 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-07 10:56:13,091 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e3ae8109578fdd9db32b92d5f9c631b6 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-07 10:56:13,091 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c27a6080404dc0d00435f95e017c7c44 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-07 10:56:13,145 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230307c29e01e3bbb04e34a2e9240835ba8375 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230307c29e01e3bbb04e34a2e9240835ba8375 2023-03-07 10:56:13,545 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303076af3d69feb6d449ea2e3e0593217476e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303076af3d69feb6d449ea2e3e0593217476e 2023-03-07 10:56:13,550 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303072d23de6b9d5a453ab8b0276be19628b0 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303072d23de6b9d5a453ab8b0276be19628b0 2023-03-07 10:56:13,561 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/.tmp/family1/4a24990df0854c2cab6cb2d866bab667 2023-03-07 10:56:13,591 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230307249cfe5af8e94bf8af346770754eafe3 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230307249cfe5af8e94bf8af346770754eafe3 2023-03-07 10:56:13,959 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/.tmp/family1/9e43d9681e224fd783fb637358fb9551 2023-03-07 10:56:13,964 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/.tmp/family1/df3eba9aa9bb4fdb8ba53e9b28e759c7 2023-03-07 10:56:13,992 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230307b9e341972bdb44579e15b88545a9d6ce to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230307b9e341972bdb44579e15b88545a9d6ce 2023-03-07 10:56:13,998 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/.tmp/family2/280eb046e0dd4094a65ebaf722c222bb 2023-03-07 10:56:14,001 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023030740b406bf5faa41f9b8825881c0d94ea1 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023030740b406bf5faa41f9b8825881c0d94ea1 2023-03-07 10:56:14,002 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/.tmp/family1/4a24990df0854c2cab6cb2d866bab667 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/4a24990df0854c2cab6cb2d866bab667 2023-03-07 10:56:14,037 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/4a24990df0854c2cab6cb2d866bab667, entries=4, sequenceid=9, filesize=5.5 K 2023-03-07 10:56:14,038 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/.tmp/family2/280eb046e0dd4094a65ebaf722c222bb as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/280eb046e0dd4094a65ebaf722c222bb 2023-03-07 10:56:14,041 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/280eb046e0dd4094a65ebaf722c222bb, entries=2, sequenceid=9, filesize=5.1 K 2023-03-07 10:56:14,042 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 0d5f3df3acacfb99246262b2f6eba2c2 in 951ms, sequenceid=9, compaction requested=false 2023-03-07 10:56:14,042 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0d5f3df3acacfb99246262b2f6eba2c2: 2023-03-07 10:56:14,042 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. 2023-03-07 10:56:14,042 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-07 10:56:14,396 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/.tmp/family2/57bf6415fc314981a45c9d174a6c6065 2023-03-07 10:56:14,399 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/.tmp/family1/9e43d9681e224fd783fb637358fb9551 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/9e43d9681e224fd783fb637358fb9551 2023-03-07 10:56:14,405 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/.tmp/family2/9e44221dd8d4443a90974f6b99759151 2023-03-07 10:56:14,409 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/.tmp/family1/df3eba9aa9bb4fdb8ba53e9b28e759c7 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/df3eba9aa9bb4fdb8ba53e9b28e759c7 2023-03-07 10:56:14,423 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/9e43d9681e224fd783fb637358fb9551, entries=4, sequenceid=9, filesize=5.5 K 2023-03-07 10:56:14,423 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/.tmp/family2/57bf6415fc314981a45c9d174a6c6065 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/57bf6415fc314981a45c9d174a6c6065 2023-03-07 10:56:14,426 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/57bf6415fc314981a45c9d174a6c6065, entries=2, sequenceid=9, filesize=5.1 K 2023-03-07 10:56:14,427 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for c27a6080404dc0d00435f95e017c7c44 in 1336ms, sequenceid=9, compaction requested=false 2023-03-07 10:56:14,427 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c27a6080404dc0d00435f95e017c7c44: 2023-03-07 10:56:14,427 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. 2023-03-07 10:56:14,427 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-07 10:56:14,441 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/df3eba9aa9bb4fdb8ba53e9b28e759c7, entries=4, sequenceid=9, filesize=5.5 K 2023-03-07 10:56:14,442 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/.tmp/family2/9e44221dd8d4443a90974f6b99759151 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/9e44221dd8d4443a90974f6b99759151 2023-03-07 10:56:14,445 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/9e44221dd8d4443a90974f6b99759151, entries=2, sequenceid=9, filesize=5.1 K 2023-03-07 10:56:14,445 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for e3ae8109578fdd9db32b92d5f9c631b6 in 1354ms, sequenceid=9, compaction requested=false 2023-03-07 10:56:14,446 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e3ae8109578fdd9db32b92d5f9c631b6: 2023-03-07 10:56:14,446 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. 2023-03-07 10:56:14,446 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-07 10:56:14,446 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-07 10:56:14,446 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:14,446 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-07 10:56:14,446 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-07 10:56:14,448 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:14,449 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:14,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:14,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:14,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:14,449 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:14,449 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:56:14,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:14,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:14,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:14,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:14,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:14,450 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-07 10:56:14,450 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b16db49[Count = 0] remaining members to acquire global barrier 2023-03-07 10:56:14,450 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-07 10:56:14,450 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:14,451 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:14,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:14,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:14,451 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-07 10:56:14,451 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-07 10:56:14,451 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:56:14,451 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:14,451 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:56:14,452 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:14,452 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-07 10:56:14,452 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:14,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:14,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:14,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:14,452 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-07 10:56:14,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:14,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:14,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:14,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:14,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:14,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:14,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:14,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:56:14,454 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-07 10:56:14,454 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-07 10:56:14,454 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:56:14,455 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:56:14,455 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-07 10:56:14,455 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:56:14,456 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:14,456 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:14,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:14,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:14,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:14,456 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:14,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:14,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:14,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:14,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:14,456 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:14,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:14,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:14,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:14,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:14,457 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:14,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:14,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:14,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:14,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:14,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:14,460 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:14,460 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-07 10:56:14,461 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-07 10:56:14,461 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:14,461 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:14,461 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-07 10:56:14,461 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:56:14,461 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:14,461 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:14,461 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:14,461 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:14,461 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:14,461 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-07 10:56:14,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:14,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:14,461 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-07 10:56:14,461 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:56:14,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:14,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:14,561 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:56:14,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:56:14,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:56:14,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:56:14,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:56:14,565 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:56:14,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-07 10:56:14,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-07 10:56:14,567 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-07 10:56:14,567 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:14,567 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-07 10:56:14,567 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-07 10:56:14,567 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:14,567 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-07 10:56:14,568 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:14,568 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:14,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:14,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:14,569 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:14,569 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:56:14,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-07 10:56:14,569 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:14,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:56:14,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-07 10:56:14,570 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-07 10:56:14,570 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-07 10:56:14,570 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-07 10:56:14,570 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-07 10:56:14,570 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:14,570 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-07 10:56:14,570 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. 2023-03-07 10:56:14,570 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. started... 2023-03-07 10:56:14,570 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-07 10:56:14,570 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. 2023-03-07 10:56:14,570 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. 2023-03-07 10:56:14,570 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c27a6080404dc0d00435f95e017c7c44 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-07 10:56:14,570 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:56:14,570 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. started... 2023-03-07 10:56:14,570 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. started... 2023-03-07 10:56:14,571 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0d5f3df3acacfb99246262b2f6eba2c2 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-07 10:56:14,571 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e3ae8109578fdd9db32b92d5f9c631b6 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-07 10:56:14,620 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230307eb9ee2d5de5a436bbc5d69e440580b96 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230307eb9ee2d5de5a436bbc5d69e440580b96 2023-03-07 10:56:14,632 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303077ad5d4b803824037a2da44f98b9e86c3 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303077ad5d4b803824037a2da44f98b9e86c3 2023-03-07 10:56:15,017 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230307fa266444fe9c49be95f1bc1ae7d256ff to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230307fa266444fe9c49be95f1bc1ae7d256ff 2023-03-07 10:56:15,035 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/.tmp/family1/eb2487f74dc8430b8b384e12ddcf27e5 2023-03-07 10:56:15,048 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/.tmp/family1/dab2a143d37b433980ccf9723967dd13 2023-03-07 10:56:15,084 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023030765ff32a47f4a4a6eb2c0b9d104379e0d to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023030765ff32a47f4a4a6eb2c0b9d104379e0d 2023-03-07 10:56:15,092 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/.tmp/family2/26f438c5a07c4c2fb23d2ede87c036c8 2023-03-07 10:56:15,096 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/.tmp/family1/dab2a143d37b433980ccf9723967dd13 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/dab2a143d37b433980ccf9723967dd13 2023-03-07 10:56:15,127 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/dab2a143d37b433980ccf9723967dd13, entries=4, sequenceid=13, filesize=5.5 K 2023-03-07 10:56:15,128 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/.tmp/family2/26f438c5a07c4c2fb23d2ede87c036c8 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/26f438c5a07c4c2fb23d2ede87c036c8 2023-03-07 10:56:15,131 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/26f438c5a07c4c2fb23d2ede87c036c8, entries=2, sequenceid=13, filesize=5.1 K 2023-03-07 10:56:15,132 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for c27a6080404dc0d00435f95e017c7c44 in 562ms, sequenceid=13, compaction requested=true 2023-03-07 10:56:15,132 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c27a6080404dc0d00435f95e017c7c44: 2023-03-07 10:56:15,132 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. 2023-03-07 10:56:15,132 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-07 10:56:15,432 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/.tmp/family1/e4a30f1ce9904019bc5b74230fc31d07 2023-03-07 10:56:15,467 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230307a168533aed824061a2599a8bf4f286e9 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230307a168533aed824061a2599a8bf4f286e9 2023-03-07 10:56:15,864 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303071e0850a0075346db909dee5c8a6f73d6 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202303071e0850a0075346db909dee5c8a6f73d6 2023-03-07 10:56:15,868 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/.tmp/family2/4929366b966948b78c27765fd8b3537f 2023-03-07 10:56:15,871 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/.tmp/family2/f9c6f9c324e44374b1b7258befa1cc9e 2023-03-07 10:56:15,871 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/.tmp/family1/e4a30f1ce9904019bc5b74230fc31d07 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/e4a30f1ce9904019bc5b74230fc31d07 2023-03-07 10:56:15,874 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/.tmp/family1/eb2487f74dc8430b8b384e12ddcf27e5 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/eb2487f74dc8430b8b384e12ddcf27e5 2023-03-07 10:56:15,896 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/e4a30f1ce9904019bc5b74230fc31d07, entries=4, sequenceid=13, filesize=5.5 K 2023-03-07 10:56:15,896 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/eb2487f74dc8430b8b384e12ddcf27e5, entries=4, sequenceid=13, filesize=5.5 K 2023-03-07 10:56:15,897 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/.tmp/family2/4929366b966948b78c27765fd8b3537f as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/4929366b966948b78c27765fd8b3537f 2023-03-07 10:56:15,897 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/.tmp/family2/f9c6f9c324e44374b1b7258befa1cc9e as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/f9c6f9c324e44374b1b7258befa1cc9e 2023-03-07 10:56:15,901 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/f9c6f9c324e44374b1b7258befa1cc9e, entries=2, sequenceid=13, filesize=5.1 K 2023-03-07 10:56:15,902 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 0d5f3df3acacfb99246262b2f6eba2c2 in 1332ms, sequenceid=13, compaction requested=true 2023-03-07 10:56:15,902 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0d5f3df3acacfb99246262b2f6eba2c2: 2023-03-07 10:56:15,902 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. 2023-03-07 10:56:15,902 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-07 10:56:15,904 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/4929366b966948b78c27765fd8b3537f, entries=2, sequenceid=13, filesize=5.1 K 2023-03-07 10:56:15,905 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for e3ae8109578fdd9db32b92d5f9c631b6 in 1335ms, sequenceid=13, compaction requested=true 2023-03-07 10:56:15,905 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e3ae8109578fdd9db32b92d5f9c631b6: 2023-03-07 10:56:15,905 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. 2023-03-07 10:56:15,905 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-07 10:56:15,905 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-07 10:56:15,905 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:15,905 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-07 10:56:15,905 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-07 10:56:15,907 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:15,907 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:15,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:15,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:15,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:15,907 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:15,907 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:56:15,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:15,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:15,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:15,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:15,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:15,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-07 10:56:15,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64df3c9e[Count = 0] remaining members to acquire global barrier 2023-03-07 10:56:15,908 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-07 10:56:15,908 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:15,909 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:15,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:15,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:15,910 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-07 10:56:15,910 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-07 10:56:15,910 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:56:15,910 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:15,910 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:56:15,912 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-07 10:56:15,912 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:15,912 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:15,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:15,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:15,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:15,912 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-07 10:56:15,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:15,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:15,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:15,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:15,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:15,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:15,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:15,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:56:15,914 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-07 10:56:15,914 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-07 10:56:15,914 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:56:15,914 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:56:15,914 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-07 10:56:15,914 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:56:15,916 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:15,916 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:15,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:15,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:15,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:15,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:15,916 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:15,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:15,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:15,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:15,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:15,917 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:15,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:15,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:15,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:15,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:15,918 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:15,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:15,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:15,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:15,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:15,920 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:15,920 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-07 10:56:15,920 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-07 10:56:15,920 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:15,920 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:15,920 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-07 10:56:15,920 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:15,920 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:56:15,920 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:15,920 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:15,920 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:15,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:15,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:15,920 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:15,920 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-07 10:56:15,920 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:56:15,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:15,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:16,021 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:56:16,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:56:16,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:56:16,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:56:16,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. with WAL disabled. Data may be lost in the event of a crash. 2023-03-07 10:56:16,025 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:56:16,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-07 10:56:16,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-07 10:56:16,027 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-07 10:56:16,027 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:16,027 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-07 10:56:16,027 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-07 10:56:16,028 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:16,028 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-07 10:56:16,033 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:16,033 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:16,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:16,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:16,033 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:16,033 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:56:16,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-07 10:56:16,034 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:16,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:56:16,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-07 10:56:16,034 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-07 10:56:16,035 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-07 10:56:16,035 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-07 10:56:16,035 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-07 10:56:16,035 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:16,035 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-07 10:56:16,035 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. 2023-03-07 10:56:16,035 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. 2023-03-07 10:56:16,035 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. started... 2023-03-07 10:56:16,035 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. 2023-03-07 10:56:16,035 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-07 10:56:16,035 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:56:16,035 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. started... 2023-03-07 10:56:16,035 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c27a6080404dc0d00435f95e017c7c44 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-07 10:56:16,035 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e3ae8109578fdd9db32b92d5f9c631b6 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-07 10:56:16,035 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. started... 2023-03-07 10:56:16,036 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0d5f3df3acacfb99246262b2f6eba2c2 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-07 10:56:16,090 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230307824a68f325474ddf8649dca45ac283f3 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230307824a68f325474ddf8649dca45ac283f3 2023-03-07 10:56:16,100 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023030738c42601bc40483c919b4f257da630fc to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023030738c42601bc40483c919b4f257da630fc 2023-03-07 10:56:16,104 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230307bf57eedf8926417ab02f402ab65f5b78 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230307bf57eedf8926417ab02f402ab65f5b78 2023-03-07 10:56:16,386 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-07 10:56:16,507 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/.tmp/family1/1eaa3224836b44d78475e55671194fc6 2023-03-07 10:56:16,519 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/.tmp/family1/9543ba422c8440708013682bed7e6557 2023-03-07 10:56:16,522 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/.tmp/family1/3bb8e5cd127d471dbe03e1b874477ccb 2023-03-07 10:56:16,540 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303072d887657a0174948bf8aa3ad18b9892c to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202303072d887657a0174948bf8aa3ad18b9892c 2023-03-07 10:56:16,567 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303079cae595928384d75b253cf763b26820a to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202303079cae595928384d75b253cf763b26820a 2023-03-07 10:56:16,945 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/.tmp/family2/8ffde1fa78864179a00075c682d2b563 2023-03-07 10:56:16,949 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/.tmp/family1/1eaa3224836b44d78475e55671194fc6 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/1eaa3224836b44d78475e55671194fc6 2023-03-07 10:56:16,957 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230307a23f0ba0c7d74711a0d564fe63dd5206 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230307a23f0ba0c7d74711a0d564fe63dd5206 2023-03-07 10:56:16,971 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/.tmp/family2/928be6eceb0443d5925f6ea5c8bd1205 2023-03-07 10:56:16,975 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/.tmp/family1/3bb8e5cd127d471dbe03e1b874477ccb as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/3bb8e5cd127d471dbe03e1b874477ccb 2023-03-07 10:56:16,977 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/1eaa3224836b44d78475e55671194fc6, entries=4, sequenceid=17, filesize=5.5 K 2023-03-07 10:56:16,978 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/.tmp/family2/8ffde1fa78864179a00075c682d2b563 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/8ffde1fa78864179a00075c682d2b563 2023-03-07 10:56:16,981 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/8ffde1fa78864179a00075c682d2b563, entries=2, sequenceid=17, filesize=5.1 K 2023-03-07 10:56:16,982 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 0d5f3df3acacfb99246262b2f6eba2c2 in 946ms, sequenceid=17, compaction requested=true 2023-03-07 10:56:16,982 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0d5f3df3acacfb99246262b2f6eba2c2: 2023-03-07 10:56:16,982 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. 2023-03-07 10:56:16,982 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-07 10:56:16,998 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/3bb8e5cd127d471dbe03e1b874477ccb, entries=4, sequenceid=17, filesize=5.5 K 2023-03-07 10:56:16,999 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/.tmp/family2/928be6eceb0443d5925f6ea5c8bd1205 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/928be6eceb0443d5925f6ea5c8bd1205 2023-03-07 10:56:17,003 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/928be6eceb0443d5925f6ea5c8bd1205, entries=2, sequenceid=17, filesize=5.1 K 2023-03-07 10:56:17,003 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for e3ae8109578fdd9db32b92d5f9c631b6 in 968ms, sequenceid=17, compaction requested=true 2023-03-07 10:56:17,004 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e3ae8109578fdd9db32b92d5f9c631b6: 2023-03-07 10:56:17,004 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. 2023-03-07 10:56:17,004 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-07 10:56:17,366 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/.tmp/family2/82bcff7eac304c83a9c95202b3976aa6 2023-03-07 10:56:17,373 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/.tmp/family1/9543ba422c8440708013682bed7e6557 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/9543ba422c8440708013682bed7e6557 2023-03-07 10:56:17,397 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/9543ba422c8440708013682bed7e6557, entries=4, sequenceid=17, filesize=5.5 K 2023-03-07 10:56:17,398 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/.tmp/family2/82bcff7eac304c83a9c95202b3976aa6 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/82bcff7eac304c83a9c95202b3976aa6 2023-03-07 10:56:17,402 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/82bcff7eac304c83a9c95202b3976aa6, entries=2, sequenceid=17, filesize=5.1 K 2023-03-07 10:56:17,403 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for c27a6080404dc0d00435f95e017c7c44 in 1368ms, sequenceid=17, compaction requested=true 2023-03-07 10:56:17,403 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c27a6080404dc0d00435f95e017c7c44: 2023-03-07 10:56:17,403 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. 2023-03-07 10:56:17,403 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-07 10:56:17,403 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-07 10:56:17,403 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:17,403 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-07 10:56:17,403 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-07 10:56:17,404 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:17,404 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:17,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:17,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:17,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:17,405 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:17,405 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:56:17,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:17,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:17,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:17,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:17,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:17,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-07 10:56:17,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ae5e1b0[Count = 0] remaining members to acquire global barrier 2023-03-07 10:56:17,406 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-07 10:56:17,407 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:17,407 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:17,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:17,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:17,408 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-07 10:56:17,408 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-07 10:56:17,408 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:17,408 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:56:17,408 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:56:17,409 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-07 10:56:17,409 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:17,409 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:17,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:17,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:17,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:17,409 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-07 10:56:17,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:17,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:17,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:17,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:17,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:17,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:17,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:17,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:56:17,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-07 10:56:17,413 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-07 10:56:17,413 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:56:17,413 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:56:17,413 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-07 10:56:17,413 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:56:17,416 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:17,416 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:17,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:17,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:17,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:17,416 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:17,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:17,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:17,416 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:17,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:17,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:17,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:17,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:17,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:17,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:17,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:17,417 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:17,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:17,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:17,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:17,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:17,419 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:17,419 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:17,420 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-07 10:56:17,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:17,420 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-07 10:56:17,420 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:56:17,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:17,420 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:17,420 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-07 10:56:17,420 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:17,420 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:17,420 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:17,420 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:17,420 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-07 10:56:17,420 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:56:17,420 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:17,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:17,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:17,520 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:56:17,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:56:17,528 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-07 10:56:17,536 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-07 10:56:17,542 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-07 10:56:17,543 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-07 10:56:17,635 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-07 10:56:17,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-07 10:56:17,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-07 10:56:17,637 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-07 10:56:17,637 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:17,637 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-07 10:56:17,637 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-07 10:56:17,638 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:17,638 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-07 10:56:17,640 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:17,640 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:17,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:17,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:17,640 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:17,640 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-07 10:56:17,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-07 10:56:17,641 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:17,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-07 10:56:17,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-07 10:56:17,641 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-07 10:56:17,641 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-07 10:56:17,641 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-07 10:56:17,641 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-07 10:56:17,641 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-07 10:56:17,641 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-07 10:56:17,642 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. 2023-03-07 10:56:17,642 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. started... 2023-03-07 10:56:17,642 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c27a6080404dc0d00435f95e017c7c44 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-07 10:56:17,644 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. 2023-03-07 10:56:17,644 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. started... 2023-03-07 10:56:17,644 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0d5f3df3acacfb99246262b2f6eba2c2 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-07 10:56:17,648 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-07 10:56:17,648 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-07 10:56:17,648 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. 2023-03-07 10:56:17,648 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. started... 2023-03-07 10:56:17,648 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e3ae8109578fdd9db32b92d5f9c631b6 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-07 10:56:18,088 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/.tmp/family1/5096210ba6014eca81c1a72b011fe3d0 2023-03-07 10:56:18,113 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5096210ba6014eca81c1a72b011fe3d0 2023-03-07 10:56:18,498 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/.tmp/family1/b340382e453647c2a125322b68896483 2023-03-07 10:56:18,499 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/.tmp/family1/7052f8d26e514dbfaf358602e74ebe04 2023-03-07 10:56:18,524 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/.tmp/family2/8907a0ff32c247b7ab2b7367fe38b4fd 2023-03-07 10:56:18,527 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7052f8d26e514dbfaf358602e74ebe04 2023-03-07 10:56:18,527 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b340382e453647c2a125322b68896483 2023-03-07 10:56:18,527 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8907a0ff32c247b7ab2b7367fe38b4fd 2023-03-07 10:56:18,528 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/.tmp/family1/5096210ba6014eca81c1a72b011fe3d0 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/5096210ba6014eca81c1a72b011fe3d0 2023-03-07 10:56:18,555 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5096210ba6014eca81c1a72b011fe3d0 2023-03-07 10:56:18,556 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/5096210ba6014eca81c1a72b011fe3d0, entries=3, sequenceid=23, filesize=5.2 K 2023-03-07 10:56:18,556 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/.tmp/family2/8907a0ff32c247b7ab2b7367fe38b4fd as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/8907a0ff32c247b7ab2b7367fe38b4fd 2023-03-07 10:56:18,561 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8907a0ff32c247b7ab2b7367fe38b4fd 2023-03-07 10:56:18,561 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/8907a0ff32c247b7ab2b7367fe38b4fd, entries=1, sequenceid=23, filesize=5.0 K 2023-03-07 10:56:18,561 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for e3ae8109578fdd9db32b92d5f9c631b6 in 913ms, sequenceid=23, compaction requested=true 2023-03-07 10:56:18,561 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e3ae8109578fdd9db32b92d5f9c631b6: 2023-03-07 10:56:18,561 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. 2023-03-07 10:56:18,562 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-07 10:56:18,958 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/.tmp/family2/6330c85ff411487da418c1b4dd72754d 2023-03-07 10:56:18,960 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6330c85ff411487da418c1b4dd72754d 2023-03-07 10:56:18,961 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/.tmp/family1/b340382e453647c2a125322b68896483 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/b340382e453647c2a125322b68896483 2023-03-07 10:56:18,983 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b340382e453647c2a125322b68896483 2023-03-07 10:56:18,983 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/b340382e453647c2a125322b68896483, entries=3, sequenceid=23, filesize=5.2 K 2023-03-07 10:56:18,984 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/.tmp/family2/6330c85ff411487da418c1b4dd72754d as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/6330c85ff411487da418c1b4dd72754d 2023-03-07 10:56:18,987 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6330c85ff411487da418c1b4dd72754d 2023-03-07 10:56:18,987 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/6330c85ff411487da418c1b4dd72754d, entries=1, sequenceid=23, filesize=5.0 K 2023-03-07 10:56:18,988 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for c27a6080404dc0d00435f95e017c7c44 in 1346ms, sequenceid=23, compaction requested=true 2023-03-07 10:56:18,988 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c27a6080404dc0d00435f95e017c7c44: 2023-03-07 10:56:18,988 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. 2023-03-07 10:56:18,988 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-07 10:56:19,357 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/.tmp/family2/25ece914642b4e5cb9159c9bafe5b59b 2023-03-07 10:56:19,360 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 25ece914642b4e5cb9159c9bafe5b59b 2023-03-07 10:56:19,361 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/.tmp/family1/7052f8d26e514dbfaf358602e74ebe04 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/7052f8d26e514dbfaf358602e74ebe04 2023-03-07 10:56:19,385 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7052f8d26e514dbfaf358602e74ebe04 2023-03-07 10:56:19,385 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/7052f8d26e514dbfaf358602e74ebe04, entries=3, sequenceid=23, filesize=5.2 K 2023-03-07 10:56:19,386 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/.tmp/family2/25ece914642b4e5cb9159c9bafe5b59b as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/25ece914642b4e5cb9159c9bafe5b59b 2023-03-07 10:56:19,389 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 25ece914642b4e5cb9159c9bafe5b59b 2023-03-07 10:56:19,389 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/25ece914642b4e5cb9159c9bafe5b59b, entries=1, sequenceid=23, filesize=5.0 K 2023-03-07 10:56:19,390 INFO [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 0d5f3df3acacfb99246262b2f6eba2c2 in 1746ms, sequenceid=23, compaction requested=true 2023-03-07 10:56:19,390 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0d5f3df3acacfb99246262b2f6eba2c2: 2023-03-07 10:56:19,390 DEBUG [rs(jenkins-hbase4.apache.org,39673,1678186416064)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. 2023-03-07 10:56:19,390 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-07 10:56:19,390 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-07 10:56:19,390 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:19,390 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-07 10:56:19,390 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-07 10:56:19,392 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:19,392 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:19,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:19,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:19,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:19,392 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:19,392 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-07 10:56:19,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:19,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:19,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:19,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:19,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:19,393 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39673,1678186416064' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-07 10:56:19,393 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a4d97d2[Count = 0] remaining members to acquire global barrier 2023-03-07 10:56:19,394 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-07 10:56:19,394 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:19,395 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:19,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:19,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:19,395 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-07 10:56:19,395 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-07 10:56:19,395 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,39673,1678186416064' in zk 2023-03-07 10:56:19,395 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:19,395 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-07 10:56:19,397 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:19,397 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-07 10:56:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:19,397 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:19,397 DEBUG [member: 'jenkins-hbase4.apache.org,39673,1678186416064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-07 10:56:19,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:19,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:19,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:19,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:19,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:19,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:19,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:19,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,39673,1678186416064': 2023-03-07 10:56:19,400 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39673,1678186416064' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-07 10:56:19,400 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-07 10:56:19,400 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-07 10:56:19,400 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-07 10:56:19,400 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-07 10:56:19,400 INFO [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-07 10:56:19,402 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:19,402 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:19,402 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:19,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:19,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-07 10:56:19,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-07 10:56:19,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:19,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:19,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-07 10:56:19,403 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:19,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:19,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:19,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:19,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:19,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-07 10:56:19,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:19,404 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:19,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:19,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-07 10:56:19,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-07 10:56:19,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:19,406 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:19,406 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-07 10:56:19,406 DEBUG [(jenkins-hbase4.apache.org,45579,1678186414835)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-07 10:56:19,406 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-07 10:56:19,406 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-07 10:56:19,406 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:19,406 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:19,406 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-07 10:56:19,406 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-07 10:56:19,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-07 10:56:19,406 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-07 10:56:19,406 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-07 10:56:19,407 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-07 10:56:19,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-07 10:56:19,407 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-07 10:56:19,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-07 10:56:19,407 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-07 10:56:19,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-07 10:56:19,507 DEBUG [Listener at localhost/42383] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-07 10:56:19,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45579] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-07 10:56:19,508 DEBUG [Listener at localhost/42383] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-07 10:56:19,508 DEBUG [Listener at localhost/42383] regionserver.HStore(1912): c27a6080404dc0d00435f95e017c7c44/family1 is initiating major compaction (all files) 2023-03-07 10:56:19,509 INFO [Listener at localhost/42383] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-07 10:56:19,509 INFO [Listener at localhost/42383] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-07 10:56:19,509 INFO [Listener at localhost/42383] regionserver.HRegion(2259): Starting compaction of c27a6080404dc0d00435f95e017c7c44/family1 in testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. 2023-03-07 10:56:19,509 INFO [Listener at localhost/42383] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/71f1e22b5b0940a1a52d4bc80e9173c8, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/9e43d9681e224fd783fb637358fb9551, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/dab2a143d37b433980ccf9723967dd13, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/9543ba422c8440708013682bed7e6557, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/b340382e453647c2a125322b68896483] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/.tmp, totalSize=27.1 K 2023-03-07 10:56:19,509 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 71f1e22b5b0940a1a52d4bc80e9173c8, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678186571200 2023-03-07 10:56:19,510 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 9e43d9681e224fd783fb637358fb9551, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678186573084 2023-03-07 10:56:19,510 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting dab2a143d37b433980ccf9723967dd13, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678186574563 2023-03-07 10:56:19,510 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 9543ba422c8440708013682bed7e6557, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678186576023 2023-03-07 10:56:19,511 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting b340382e453647c2a125322b68896483, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-07 10:56:19,519 INFO [Listener at localhost/42383] throttle.PressureAwareThroughputController(145): c27a6080404dc0d00435f95e017c7c44#family1#compaction#198 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:56:19,960 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230307050c551ff7f841599940cd7760d446e6_del 2023-03-07 10:56:19,960 INFO [Listener at localhost/42383] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230307050c551ff7f841599940cd7760d446e6_del to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230307050c551ff7f841599940cd7760d446e6_del 2023-03-07 10:56:20,815 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 944093a0a3bf489da5feb682b55e23ba 2023-03-07 10:56:20,816 DEBUG [Listener at localhost/42383] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/.tmp/family1/944093a0a3bf489da5feb682b55e23ba as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/944093a0a3bf489da5feb682b55e23ba 2023-03-07 10:56:20,837 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 944093a0a3bf489da5feb682b55e23ba 2023-03-07 10:56:20,838 INFO [Listener at localhost/42383] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c27a6080404dc0d00435f95e017c7c44/family1 of c27a6080404dc0d00435f95e017c7c44 into 944093a0a3bf489da5feb682b55e23ba(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-07 10:56:20,839 DEBUG [Listener at localhost/42383] regionserver.HRegion(2289): Compaction status journal for c27a6080404dc0d00435f95e017c7c44: 2023-03-07 10:56:20,839 DEBUG [Listener at localhost/42383] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-07 10:56:20,839 DEBUG [Listener at localhost/42383] regionserver.HStore(1912): c27a6080404dc0d00435f95e017c7c44/family2 is initiating major compaction (all files) 2023-03-07 10:56:20,839 INFO [Listener at localhost/42383] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-07 10:56:20,839 INFO [Listener at localhost/42383] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-07 10:56:20,839 INFO [Listener at localhost/42383] regionserver.HRegion(2259): Starting compaction of c27a6080404dc0d00435f95e017c7c44/family2 in testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. 2023-03-07 10:56:20,839 INFO [Listener at localhost/42383] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/bb6e82612db843dfb5f993f34c5d68f0, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/57bf6415fc314981a45c9d174a6c6065, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/26f438c5a07c4c2fb23d2ede87c036c8, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/82bcff7eac304c83a9c95202b3976aa6, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/6330c85ff411487da418c1b4dd72754d] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/.tmp, totalSize=25.4 K 2023-03-07 10:56:20,840 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting bb6e82612db843dfb5f993f34c5d68f0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678186571200 2023-03-07 10:56:20,840 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 57bf6415fc314981a45c9d174a6c6065, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678186573084 2023-03-07 10:56:20,840 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 26f438c5a07c4c2fb23d2ede87c036c8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678186574563 2023-03-07 10:56:20,841 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 82bcff7eac304c83a9c95202b3976aa6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678186576023 2023-03-07 10:56:20,841 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 6330c85ff411487da418c1b4dd72754d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-07 10:56:20,849 INFO [Listener at localhost/42383] throttle.PressureAwareThroughputController(145): c27a6080404dc0d00435f95e017c7c44#family2#compaction#199 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:56:20,879 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/71f1e22b5b0940a1a52d4bc80e9173c8, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/9e43d9681e224fd783fb637358fb9551, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/dab2a143d37b433980ccf9723967dd13, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/9543ba422c8440708013682bed7e6557, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/b340382e453647c2a125322b68896483] to archive 2023-03-07 10:56:20,880 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:56:20,881 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/71f1e22b5b0940a1a52d4bc80e9173c8 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/71f1e22b5b0940a1a52d4bc80e9173c8 2023-03-07 10:56:20,882 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/9e43d9681e224fd783fb637358fb9551 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/9e43d9681e224fd783fb637358fb9551 2023-03-07 10:56:20,883 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/dab2a143d37b433980ccf9723967dd13 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/dab2a143d37b433980ccf9723967dd13 2023-03-07 10:56:20,884 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/9543ba422c8440708013682bed7e6557 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/9543ba422c8440708013682bed7e6557 2023-03-07 10:56:20,885 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/b340382e453647c2a125322b68896483 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/b340382e453647c2a125322b68896483 2023-03-07 10:56:21,258 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023030787c20d98946e43a5b551563321138279_del 2023-03-07 10:56:21,258 INFO [Listener at localhost/42383] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023030787c20d98946e43a5b551563321138279_del to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023030787c20d98946e43a5b551563321138279_del 2023-03-07 10:56:22,077 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 220576265bd3424d979be1836d17012e 2023-03-07 10:56:22,077 DEBUG [Listener at localhost/42383] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/.tmp/family2/220576265bd3424d979be1836d17012e as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/220576265bd3424d979be1836d17012e 2023-03-07 10:56:22,081 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 220576265bd3424d979be1836d17012e 2023-03-07 10:56:22,081 INFO [Listener at localhost/42383] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c27a6080404dc0d00435f95e017c7c44/family2 of c27a6080404dc0d00435f95e017c7c44 into 220576265bd3424d979be1836d17012e(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-07 10:56:22,081 DEBUG [Listener at localhost/42383] regionserver.HRegion(2289): Compaction status journal for c27a6080404dc0d00435f95e017c7c44: 2023-03-07 10:56:22,082 DEBUG [Listener at localhost/42383] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-07 10:56:22,082 DEBUG [Listener at localhost/42383] regionserver.HStore(1912): 0d5f3df3acacfb99246262b2f6eba2c2/family1 is initiating major compaction (all files) 2023-03-07 10:56:22,082 INFO [Listener at localhost/42383] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-07 10:56:22,082 INFO [Listener at localhost/42383] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-07 10:56:22,083 INFO [Listener at localhost/42383] regionserver.HRegion(2259): Starting compaction of 0d5f3df3acacfb99246262b2f6eba2c2/family1 in testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. 2023-03-07 10:56:22,083 INFO [Listener at localhost/42383] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/f2635941ab044dfc83b5623067b68c8d, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/4a24990df0854c2cab6cb2d866bab667, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/eb2487f74dc8430b8b384e12ddcf27e5, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/1eaa3224836b44d78475e55671194fc6, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/7052f8d26e514dbfaf358602e74ebe04] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/.tmp, totalSize=27.1 K 2023-03-07 10:56:22,083 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting f2635941ab044dfc83b5623067b68c8d, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678186571200 2023-03-07 10:56:22,083 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 4a24990df0854c2cab6cb2d866bab667, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678186573084 2023-03-07 10:56:22,084 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting eb2487f74dc8430b8b384e12ddcf27e5, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678186574563 2023-03-07 10:56:22,084 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 1eaa3224836b44d78475e55671194fc6, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678186576023 2023-03-07 10:56:22,084 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 7052f8d26e514dbfaf358602e74ebe04, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-07 10:56:22,093 INFO [Listener at localhost/42383] throttle.PressureAwareThroughputController(145): 0d5f3df3acacfb99246262b2f6eba2c2#family1#compaction#200 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:56:22,139 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023030735d47fa0126a4d23a391122c6028b470_del 2023-03-07 10:56:22,139 INFO [Listener at localhost/42383] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023030735d47fa0126a4d23a391122c6028b470_del to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023030735d47fa0126a4d23a391122c6028b470_del 2023-03-07 10:56:22,179 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/bb6e82612db843dfb5f993f34c5d68f0, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/57bf6415fc314981a45c9d174a6c6065, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/26f438c5a07c4c2fb23d2ede87c036c8, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/82bcff7eac304c83a9c95202b3976aa6, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/6330c85ff411487da418c1b4dd72754d] to archive 2023-03-07 10:56:22,180 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:56:22,187 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/bb6e82612db843dfb5f993f34c5d68f0 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/bb6e82612db843dfb5f993f34c5d68f0 2023-03-07 10:56:22,188 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/57bf6415fc314981a45c9d174a6c6065 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/57bf6415fc314981a45c9d174a6c6065 2023-03-07 10:56:22,189 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/26f438c5a07c4c2fb23d2ede87c036c8 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/26f438c5a07c4c2fb23d2ede87c036c8 2023-03-07 10:56:22,190 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/82bcff7eac304c83a9c95202b3976aa6 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/82bcff7eac304c83a9c95202b3976aa6 2023-03-07 10:56:22,191 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/6330c85ff411487da418c1b4dd72754d to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family2/6330c85ff411487da418c1b4dd72754d 2023-03-07 10:56:22,622 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eac2bf052ab94ae9aee818a2e8c15f09 2023-03-07 10:56:22,622 DEBUG [Listener at localhost/42383] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/.tmp/family1/eac2bf052ab94ae9aee818a2e8c15f09 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/eac2bf052ab94ae9aee818a2e8c15f09 2023-03-07 10:56:22,644 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eac2bf052ab94ae9aee818a2e8c15f09 2023-03-07 10:56:22,645 INFO [Listener at localhost/42383] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0d5f3df3acacfb99246262b2f6eba2c2/family1 of 0d5f3df3acacfb99246262b2f6eba2c2 into eac2bf052ab94ae9aee818a2e8c15f09(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-07 10:56:22,645 DEBUG [Listener at localhost/42383] regionserver.HRegion(2289): Compaction status journal for 0d5f3df3acacfb99246262b2f6eba2c2: 2023-03-07 10:56:22,645 DEBUG [Listener at localhost/42383] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-07 10:56:22,645 DEBUG [Listener at localhost/42383] regionserver.HStore(1912): 0d5f3df3acacfb99246262b2f6eba2c2/family2 is initiating major compaction (all files) 2023-03-07 10:56:22,645 INFO [Listener at localhost/42383] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-07 10:56:22,645 INFO [Listener at localhost/42383] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-07 10:56:22,647 INFO [Listener at localhost/42383] regionserver.HRegion(2259): Starting compaction of 0d5f3df3acacfb99246262b2f6eba2c2/family2 in testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. 2023-03-07 10:56:22,647 INFO [Listener at localhost/42383] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/2e4f44640cc54d7db64e7a5d9ddd5804, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/280eb046e0dd4094a65ebaf722c222bb, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/f9c6f9c324e44374b1b7258befa1cc9e, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/8ffde1fa78864179a00075c682d2b563, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/25ece914642b4e5cb9159c9bafe5b59b] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/.tmp, totalSize=25.4 K 2023-03-07 10:56:22,648 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 2e4f44640cc54d7db64e7a5d9ddd5804, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678186571200 2023-03-07 10:56:22,648 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 280eb046e0dd4094a65ebaf722c222bb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678186573084 2023-03-07 10:56:22,648 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting f9c6f9c324e44374b1b7258befa1cc9e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678186574563 2023-03-07 10:56:22,648 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 8ffde1fa78864179a00075c682d2b563, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678186576023 2023-03-07 10:56:22,649 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 25ece914642b4e5cb9159c9bafe5b59b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-07 10:56:22,655 INFO [Listener at localhost/42383] throttle.PressureAwareThroughputController(145): 0d5f3df3acacfb99246262b2f6eba2c2#family2#compaction#201 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:56:22,663 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023030797a335ddf49640468c589baaf009be29_del 2023-03-07 10:56:22,663 INFO [Listener at localhost/42383] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023030797a335ddf49640468c589baaf009be29_del to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023030797a335ddf49640468c589baaf009be29_del 2023-03-07 10:56:22,679 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/f2635941ab044dfc83b5623067b68c8d, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/4a24990df0854c2cab6cb2d866bab667, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/eb2487f74dc8430b8b384e12ddcf27e5, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/1eaa3224836b44d78475e55671194fc6, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/7052f8d26e514dbfaf358602e74ebe04] to archive 2023-03-07 10:56:22,680 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:56:22,681 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/f2635941ab044dfc83b5623067b68c8d to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/f2635941ab044dfc83b5623067b68c8d 2023-03-07 10:56:22,683 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/4a24990df0854c2cab6cb2d866bab667 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/4a24990df0854c2cab6cb2d866bab667 2023-03-07 10:56:22,684 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/eb2487f74dc8430b8b384e12ddcf27e5 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/eb2487f74dc8430b8b384e12ddcf27e5 2023-03-07 10:56:22,685 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/1eaa3224836b44d78475e55671194fc6 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/1eaa3224836b44d78475e55671194fc6 2023-03-07 10:56:22,686 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/7052f8d26e514dbfaf358602e74ebe04 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/7052f8d26e514dbfaf358602e74ebe04 2023-03-07 10:56:23,481 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 672df308f17e45f9b7e7f15945ca4560 2023-03-07 10:56:23,481 DEBUG [Listener at localhost/42383] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/.tmp/family2/672df308f17e45f9b7e7f15945ca4560 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/672df308f17e45f9b7e7f15945ca4560 2023-03-07 10:56:23,485 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 672df308f17e45f9b7e7f15945ca4560 2023-03-07 10:56:23,486 INFO [Listener at localhost/42383] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0d5f3df3acacfb99246262b2f6eba2c2/family2 of 0d5f3df3acacfb99246262b2f6eba2c2 into 672df308f17e45f9b7e7f15945ca4560(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-07 10:56:23,486 DEBUG [Listener at localhost/42383] regionserver.HRegion(2289): Compaction status journal for 0d5f3df3acacfb99246262b2f6eba2c2: 2023-03-07 10:56:23,486 DEBUG [Listener at localhost/42383] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-07 10:56:23,486 DEBUG [Listener at localhost/42383] regionserver.HStore(1912): e3ae8109578fdd9db32b92d5f9c631b6/family1 is initiating major compaction (all files) 2023-03-07 10:56:23,486 INFO [Listener at localhost/42383] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-07 10:56:23,486 INFO [Listener at localhost/42383] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-07 10:56:23,487 INFO [Listener at localhost/42383] regionserver.HRegion(2259): Starting compaction of e3ae8109578fdd9db32b92d5f9c631b6/family1 in testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. 2023-03-07 10:56:23,487 INFO [Listener at localhost/42383] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/ae8bafa1fa86480683b1452505bf961e, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/df3eba9aa9bb4fdb8ba53e9b28e759c7, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/e4a30f1ce9904019bc5b74230fc31d07, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/3bb8e5cd127d471dbe03e1b874477ccb, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/5096210ba6014eca81c1a72b011fe3d0] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/.tmp, totalSize=27.1 K 2023-03-07 10:56:23,487 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting ae8bafa1fa86480683b1452505bf961e, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678186571199 2023-03-07 10:56:23,488 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting df3eba9aa9bb4fdb8ba53e9b28e759c7, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678186573084 2023-03-07 10:56:23,488 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting e4a30f1ce9904019bc5b74230fc31d07, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678186574563 2023-03-07 10:56:23,488 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 3bb8e5cd127d471dbe03e1b874477ccb, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678186576022 2023-03-07 10:56:23,488 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 5096210ba6014eca81c1a72b011fe3d0, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-07 10:56:23,495 INFO [Listener at localhost/42383] throttle.PressureAwareThroughputController(145): e3ae8109578fdd9db32b92d5f9c631b6#family1#compaction#202 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:56:23,579 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/2e4f44640cc54d7db64e7a5d9ddd5804, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/280eb046e0dd4094a65ebaf722c222bb, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/f9c6f9c324e44374b1b7258befa1cc9e, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/8ffde1fa78864179a00075c682d2b563, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/25ece914642b4e5cb9159c9bafe5b59b] to archive 2023-03-07 10:56:23,580 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:56:23,581 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/2e4f44640cc54d7db64e7a5d9ddd5804 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/2e4f44640cc54d7db64e7a5d9ddd5804 2023-03-07 10:56:23,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/280eb046e0dd4094a65ebaf722c222bb to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/280eb046e0dd4094a65ebaf722c222bb 2023-03-07 10:56:23,583 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/f9c6f9c324e44374b1b7258befa1cc9e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/f9c6f9c324e44374b1b7258befa1cc9e 2023-03-07 10:56:23,584 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/8ffde1fa78864179a00075c682d2b563 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/8ffde1fa78864179a00075c682d2b563 2023-03-07 10:56:23,585 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/25ece914642b4e5cb9159c9bafe5b59b to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family2/25ece914642b4e5cb9159c9bafe5b59b 2023-03-07 10:56:23,947 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-07 10:56:23,947 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1bdd3ed3 to 127.0.0.1:56055 2023-03-07 10:56:23,947 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-07 10:56:23,958 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023030730a34dad8eec45679a48b5e0a4e896dd_del 2023-03-07 10:56:23,958 INFO [Listener at localhost/42383] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023030730a34dad8eec45679a48b5e0a4e896dd_del to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023030730a34dad8eec45679a48b5e0a4e896dd_del 2023-03-07 10:56:24,814 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 56d711d522734df0b01ea5f55e97a807 2023-03-07 10:56:24,815 DEBUG [Listener at localhost/42383] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/.tmp/family1/56d711d522734df0b01ea5f55e97a807 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/56d711d522734df0b01ea5f55e97a807 2023-03-07 10:56:24,837 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 56d711d522734df0b01ea5f55e97a807 2023-03-07 10:56:24,838 INFO [Listener at localhost/42383] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e3ae8109578fdd9db32b92d5f9c631b6/family1 of e3ae8109578fdd9db32b92d5f9c631b6 into 56d711d522734df0b01ea5f55e97a807(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-07 10:56:24,838 DEBUG [Listener at localhost/42383] regionserver.HRegion(2289): Compaction status journal for e3ae8109578fdd9db32b92d5f9c631b6: 2023-03-07 10:56:24,838 DEBUG [Listener at localhost/42383] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-07 10:56:24,838 DEBUG [Listener at localhost/42383] regionserver.HStore(1912): e3ae8109578fdd9db32b92d5f9c631b6/family2 is initiating major compaction (all files) 2023-03-07 10:56:24,838 INFO [Listener at localhost/42383] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-07 10:56:24,838 INFO [Listener at localhost/42383] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-07 10:56:24,838 INFO [Listener at localhost/42383] regionserver.HRegion(2259): Starting compaction of e3ae8109578fdd9db32b92d5f9c631b6/family2 in testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. 2023-03-07 10:56:24,838 INFO [Listener at localhost/42383] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/ab5e45f7cf99442ab017c41c9d20c45a, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/9e44221dd8d4443a90974f6b99759151, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/4929366b966948b78c27765fd8b3537f, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/928be6eceb0443d5925f6ea5c8bd1205, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/8907a0ff32c247b7ab2b7367fe38b4fd] into tmpdir=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/.tmp, totalSize=25.4 K 2023-03-07 10:56:24,839 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting ab5e45f7cf99442ab017c41c9d20c45a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678186571199 2023-03-07 10:56:24,839 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 9e44221dd8d4443a90974f6b99759151, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678186573084 2023-03-07 10:56:24,839 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 4929366b966948b78c27765fd8b3537f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678186574563 2023-03-07 10:56:24,839 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 928be6eceb0443d5925f6ea5c8bd1205, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678186576022 2023-03-07 10:56:24,840 DEBUG [Listener at localhost/42383] compactions.Compactor(207): Compacting 8907a0ff32c247b7ab2b7367fe38b4fd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-07 10:56:24,846 INFO [Listener at localhost/42383] throttle.PressureAwareThroughputController(145): e3ae8109578fdd9db32b92d5f9c631b6#family2#compaction#203 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-07 10:56:24,879 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/ae8bafa1fa86480683b1452505bf961e, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/df3eba9aa9bb4fdb8ba53e9b28e759c7, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/e4a30f1ce9904019bc5b74230fc31d07, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/3bb8e5cd127d471dbe03e1b874477ccb, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/5096210ba6014eca81c1a72b011fe3d0] to archive 2023-03-07 10:56:24,880 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:56:24,881 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/ae8bafa1fa86480683b1452505bf961e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/ae8bafa1fa86480683b1452505bf961e 2023-03-07 10:56:24,882 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/df3eba9aa9bb4fdb8ba53e9b28e759c7 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/df3eba9aa9bb4fdb8ba53e9b28e759c7 2023-03-07 10:56:24,882 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/e4a30f1ce9904019bc5b74230fc31d07 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/e4a30f1ce9904019bc5b74230fc31d07 2023-03-07 10:56:24,883 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/3bb8e5cd127d471dbe03e1b874477ccb to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/3bb8e5cd127d471dbe03e1b874477ccb 2023-03-07 10:56:24,884 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/5096210ba6014eca81c1a72b011fe3d0 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/5096210ba6014eca81c1a72b011fe3d0 2023-03-07 10:56:25,253 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230307ea69c84b7cc348089af2db49c7c664d8_del 2023-03-07 10:56:25,253 INFO [Listener at localhost/42383] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230307ea69c84b7cc348089af2db49c7c664d8_del to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230307ea69c84b7cc348089af2db49c7c664d8_del 2023-03-07 10:56:25,666 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f40164440e2642d3b1558c2438cc04e7 2023-03-07 10:56:25,666 DEBUG [Listener at localhost/42383] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/.tmp/family2/f40164440e2642d3b1558c2438cc04e7 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/f40164440e2642d3b1558c2438cc04e7 2023-03-07 10:56:25,669 INFO [Listener at localhost/42383] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f40164440e2642d3b1558c2438cc04e7 2023-03-07 10:56:25,670 INFO [Listener at localhost/42383] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e3ae8109578fdd9db32b92d5f9c631b6/family2 of e3ae8109578fdd9db32b92d5f9c631b6 into f40164440e2642d3b1558c2438cc04e7(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-07 10:56:25,670 DEBUG [Listener at localhost/42383] regionserver.HRegion(2289): Compaction status journal for e3ae8109578fdd9db32b92d5f9c631b6: 2023-03-07 10:56:25,673 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-07 10:56:25,676 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-07 10:56:25,679 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-07 10:56:25,679 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-07 10:56:25,684 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45579] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x888f\x0A\xCB\xC2\xA5\xA2\xED\x97o:\x0B\x11\xAFD"\x10s C\xC9\xD5{{\x0C\xD2Q=|\x8F\xFF\xA5\xEC*\x10+\xC3\xDC\x88\x1A\x94\x8DX\xE5nl4\xC4]C\x1F2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-03-07 10:56:25,688 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/ab5e45f7cf99442ab017c41c9d20c45a, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/9e44221dd8d4443a90974f6b99759151, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/4929366b966948b78c27765fd8b3537f, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/928be6eceb0443d5925f6ea5c8bd1205, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/8907a0ff32c247b7ab2b7367fe38b4fd] to archive 2023-03-07 10:56:25,689 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:56:25,690 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/ab5e45f7cf99442ab017c41c9d20c45a to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/ab5e45f7cf99442ab017c41c9d20c45a 2023-03-07 10:56:25,692 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/9e44221dd8d4443a90974f6b99759151 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/9e44221dd8d4443a90974f6b99759151 2023-03-07 10:56:25,693 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/4929366b966948b78c27765fd8b3537f to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/4929366b966948b78c27765fd8b3537f 2023-03-07 10:56:25,695 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/928be6eceb0443d5925f6ea5c8bd1205 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/928be6eceb0443d5925f6ea5c8bd1205 2023-03-07 10:56:25,696 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/8907a0ff32c247b7ab2b7367fe38b4fd to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family2/8907a0ff32c247b7ab2b7367fe38b4fd 2023-03-07 10:56:25,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-07 10:56:25,713 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-07 10:56:25,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:56:25,714 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678187185714 2023-03-07 10:56:25,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-07 10:56:25,790 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-07 10:56:26,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-03-07 10:56:26,041 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023030730a34dad8eec45679a48b5e0a4e896dd_del 2023-03-07 10:56:26,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023030735d47fa0126a4d23a391122c6028b470_del 2023-03-07 10:56:26,081 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230307050c551ff7f841599940cd7760d446e6_del 2023-03-07 10:56:26,081 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-03-07 10:56:26,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] zookeeper.ReadOnlyZKClient(139): Connect 0x33a8a557 to 127.0.0.1:56055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-07 10:56:26,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c35f4fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-07 10:56:26,085 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230307 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-07 10:56:27,030 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023030722f06784c5554aaea8737472808acab1 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023030722f06784c5554aaea8737472808acab1 2023-03-07 10:56:27,031 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230307 table='testMajorCompactionFromAdmin' column='family1' 2023-03-07 10:56:27,034 DEBUG [regionserver/jenkins-hbase4:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-07 10:56:27,045 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-07 10:56:27,047 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40230, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-07 10:56:27,055 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-07 10:56:27,056 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42624, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-07 10:56:27,082 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230307/family1/969b08842ece4138b1aba30463ba6de6 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-03-07 10:56:27,083 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230307/family1/969b08842ece4138b1aba30463ba6de6}] 2023-03-07 10:56:27,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230307/family1/969b08842ece4138b1aba30463ba6de6 for inclusion in e3ae8109578fdd9db32b92d5f9c631b6/family1 2023-03-07 10:56:27,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-03-07 10:56:27,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(777): Region bounds: first= last=1 2023-03-07 10:56:27,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for e3ae8109578fdd9db32b92d5f9c631b6: 2023-03-07 10:56:27,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230307/family1/969b08842ece4138b1aba30463ba6de6 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionFromAdmin__nt8ovv0c05k6oq9spaa60jrhqu5ou910p9mqrecb832kivsf6rh0nbljc6k76jm4/family1/969b08842ece4138b1aba30463ba6de6 2023-03-07 10:56:27,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionFromAdmin__nt8ovv0c05k6oq9spaa60jrhqu5ou910p9mqrecb832kivsf6rh0nbljc6k76jm4/family1/969b08842ece4138b1aba30463ba6de6 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/201ddf0811af4521b6e5b97470b7d91e_SeqId_28_ 2023-03-07 10:56:27,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionFromAdmin__nt8ovv0c05k6oq9spaa60jrhqu5ou910p9mqrecb832kivsf6rh0nbljc6k76jm4/family1/969b08842ece4138b1aba30463ba6de6 into e3ae8109578fdd9db32b92d5f9c631b6/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/201ddf0811af4521b6e5b97470b7d91e_SeqId_28_ - updating store file list. 2023-03-07 10:56:27,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/201ddf0811af4521b6e5b97470b7d91e_SeqId_28_ into e3ae8109578fdd9db32b92d5f9c631b6/family1 2023-03-07 10:56:27,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionFromAdmin__nt8ovv0c05k6oq9spaa60jrhqu5ou910p9mqrecb832kivsf6rh0nbljc6k76jm4/family1/969b08842ece4138b1aba30463ba6de6 into e3ae8109578fdd9db32b92d5f9c631b6/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/family1/201ddf0811af4521b6e5b97470b7d91e_SeqId_28_) 2023-03-07 10:56:27,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionFromAdmin__nt8ovv0c05k6oq9spaa60jrhqu5ou910p9mqrecb832kivsf6rh0nbljc6k76jm4/family1/969b08842ece4138b1aba30463ba6de6 2023-03-07 10:56:27,135 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230307 table='testMajorCompactionFromAdmin' column='family1' 2023-03-07 10:56:27,135 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:56:27,136 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303071b2944f7c40540088b6b46f23ebd86f7 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303071b2944f7c40540088b6b46f23ebd86f7 2023-03-07 10:56:27,137 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303072d23de6b9d5a453ab8b0276be19628b0 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303072d23de6b9d5a453ab8b0276be19628b0 2023-03-07 10:56:27,139 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230307bf57eedf8926417ab02f402ab65f5b78 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230307bf57eedf8926417ab02f402ab65f5b78 2023-03-07 10:56:27,140 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230307fa266444fe9c49be95f1bc1ae7d256ff to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230307fa266444fe9c49be95f1bc1ae7d256ff 2023-03-07 10:56:27,140 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-07 10:56:27,140 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230307' 2023-03-07 10:56:27,140 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230307 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-07 10:56:27,140 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230307 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-07 10:56:27,721 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023030776351d5d5789448397e1b3dfaaab704f to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023030776351d5d5789448397e1b3dfaaab704f 2023-03-07 10:56:27,722 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230307 table='testMajorCompactionFromAdmin' column='family1' 2023-03-07 10:56:27,760 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230307/family1/30b3e02003844f1b8da8861b43717119 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-03-07 10:56:27,761 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230307/family1/30b3e02003844f1b8da8861b43717119}] 2023-03-07 10:56:27,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230307/family1/30b3e02003844f1b8da8861b43717119 for inclusion in 0d5f3df3acacfb99246262b2f6eba2c2/family1 2023-03-07 10:56:27,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-03-07 10:56:27,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-07 10:56:27,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for 0d5f3df3acacfb99246262b2f6eba2c2: 2023-03-07 10:56:27,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230307/family1/30b3e02003844f1b8da8861b43717119 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionFromAdmin__cd7mjqphend8p0hamk64atrll1llcanp2dl20onic7n2cs40j5oi1assolc7qg5n/family1/30b3e02003844f1b8da8861b43717119 2023-03-07 10:56:27,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionFromAdmin__cd7mjqphend8p0hamk64atrll1llcanp2dl20onic7n2cs40j5oi1assolc7qg5n/family1/30b3e02003844f1b8da8861b43717119 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/1a3a4ac5bb114d0d83477f3ac5615bca_SeqId_28_ 2023-03-07 10:56:27,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionFromAdmin__cd7mjqphend8p0hamk64atrll1llcanp2dl20onic7n2cs40j5oi1assolc7qg5n/family1/30b3e02003844f1b8da8861b43717119 into 0d5f3df3acacfb99246262b2f6eba2c2/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/1a3a4ac5bb114d0d83477f3ac5615bca_SeqId_28_ - updating store file list. 2023-03-07 10:56:27,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/1a3a4ac5bb114d0d83477f3ac5615bca_SeqId_28_ into 0d5f3df3acacfb99246262b2f6eba2c2/family1 2023-03-07 10:56:27,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionFromAdmin__cd7mjqphend8p0hamk64atrll1llcanp2dl20onic7n2cs40j5oi1assolc7qg5n/family1/30b3e02003844f1b8da8861b43717119 into 0d5f3df3acacfb99246262b2f6eba2c2/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/family1/1a3a4ac5bb114d0d83477f3ac5615bca_SeqId_28_) 2023-03-07 10:56:27,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionFromAdmin__cd7mjqphend8p0hamk64atrll1llcanp2dl20onic7n2cs40j5oi1assolc7qg5n/family1/30b3e02003844f1b8da8861b43717119 2023-03-07 10:56:27,830 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230307 table='testMajorCompactionFromAdmin' column='family1' 2023-03-07 10:56:27,830 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:56:27,832 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303071322f576bb234faf8db04d38b4176181 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303071322f576bb234faf8db04d38b4176181 2023-03-07 10:56:27,833 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230307824a68f325474ddf8649dca45ac283f3 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230307824a68f325474ddf8649dca45ac283f3 2023-03-07 10:56:27,833 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230307c29e01e3bbb04e34a2e9240835ba8375 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230307c29e01e3bbb04e34a2e9240835ba8375 2023-03-07 10:56:27,834 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230307eb9ee2d5de5a436bbc5d69e440580b96 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230307eb9ee2d5de5a436bbc5d69e440580b96 2023-03-07 10:56:27,834 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-07 10:56:27,835 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230307' 2023-03-07 10:56:27,835 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230307 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-07 10:56:27,835 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230307 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-07 10:56:28,274 DEBUG [regionserver/jenkins-hbase4:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-07 10:56:28,793 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023030739b3416c4b004fde8cfa6fab3ebf4caf to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023030739b3416c4b004fde8cfa6fab3ebf4caf 2023-03-07 10:56:28,793 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230307 table='testMajorCompactionFromAdmin' column='family1' 2023-03-07 10:56:28,830 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230307/family1/9041f9d4799a4ba48fee00045cc277a7 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-03-07 10:56:28,831 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44., hostname=jenkins-hbase4.apache.org,39673,1678186416064, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230307/family1/9041f9d4799a4ba48fee00045cc277a7}] 2023-03-07 10:56:28,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(763): Validating hfile at hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230307/family1/9041f9d4799a4ba48fee00045cc277a7 for inclusion in c27a6080404dc0d00435f95e017c7c44/family1 2023-03-07 10:56:28,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-03-07 10:56:28,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-07 10:56:28,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegion(2446): Flush status journal for c27a6080404dc0d00435f95e017c7c44: 2023-03-07 10:56:28,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230307/family1/9041f9d4799a4ba48fee00045cc277a7 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionFromAdmin__k6731thv7nmjd4a5ik23j0et0nrk5kp0drla271khialfmuds86mah4e2b046bno/family1/9041f9d4799a4ba48fee00045cc277a7 2023-03-07 10:56:28,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionFromAdmin__k6731thv7nmjd4a5ik23j0et0nrk5kp0drla271khialfmuds86mah4e2b046bno/family1/9041f9d4799a4ba48fee00045cc277a7 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/cdd73f538f634fb9a7ab6e712f221922_SeqId_28_ 2023-03-07 10:56:28,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(849): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionFromAdmin__k6731thv7nmjd4a5ik23j0et0nrk5kp0drla271khialfmuds86mah4e2b046bno/family1/9041f9d4799a4ba48fee00045cc277a7 into c27a6080404dc0d00435f95e017c7c44/family1 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/cdd73f538f634fb9a7ab6e712f221922_SeqId_28_ - updating store file list. 2023-03-07 10:56:28,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(882): Loaded HFile hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/cdd73f538f634fb9a7ab6e712f221922_SeqId_28_ into c27a6080404dc0d00435f95e017c7c44/family1 2023-03-07 10:56:28,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.HStore(855): Successfully loaded hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionFromAdmin__k6731thv7nmjd4a5ik23j0et0nrk5kp0drla271khialfmuds86mah4e2b046bno/family1/9041f9d4799a4ba48fee00045cc277a7 into c27a6080404dc0d00435f95e017c7c44/family1 (new location: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/family1/cdd73f538f634fb9a7ab6e712f221922_SeqId_28_) 2023-03-07 10:56:28,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39673] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/staging/jenkins__testMajorCompactionFromAdmin__k6731thv7nmjd4a5ik23j0et0nrk5kp0drla271khialfmuds86mah4e2b046bno/family1/9041f9d4799a4ba48fee00045cc277a7 2023-03-07 10:56:28,877 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230307 table='testMajorCompactionFromAdmin' column='family1' 2023-03-07 10:56:28,878 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:56:28,879 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023030738c42601bc40483c919b4f257da630fc to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023030738c42601bc40483c919b4f257da630fc 2023-03-07 10:56:28,880 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303076af3d69feb6d449ea2e3e0593217476e to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303076af3d69feb6d449ea2e3e0593217476e 2023-03-07 10:56:28,880 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303077ad5d4b803824037a2da44f98b9e86c3 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303077ad5d4b803824037a2da44f98b9e86c3 2023-03-07 10:56:28,881 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230307d7a690305bd047e887e0c9020ffb45f0 to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230307d7a690305bd047e887e0c9020ffb45f0 2023-03-07 10:56:28,881 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-07 10:56:28,881 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230307' 2023-03-07 10:56:28,882 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230307 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-07 10:56:28,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-03-07 10:56:28,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-07 10:56:28,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023030730a34dad8eec45679a48b5e0a4e896dd_del] 2023-03-07 10:56:28,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:56:28,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023030730a34dad8eec45679a48b5e0a4e896dd_del to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023030730a34dad8eec45679a48b5e0a4e896dd_del 2023-03-07 10:56:28,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-07 10:56:28,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023030735d47fa0126a4d23a391122c6028b470_del] 2023-03-07 10:56:28,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:56:28,885 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023030735d47fa0126a4d23a391122c6028b470_del to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023030735d47fa0126a4d23a391122c6028b470_del 2023-03-07 10:56:28,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-07 10:56:28,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230307050c551ff7f841599940cd7760d446e6_del] 2023-03-07 10:56:28,885 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] backup.HFileArchiver(360): Archiving compacted files. 2023-03-07 10:56:28,886 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230307050c551ff7f841599940cd7760d446e6_del to hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230307050c551ff7f841599940cd7760d446e6_del 2023-03-07 10:56:28,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-07 10:56:28,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678186418752] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-07 10:56:28,887 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-07 10:56:28,888 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 3.1750 sec 2023-03-07 10:56:28,908 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-07 10:56:28,910 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-07 10:56:28,912 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-07 10:56:28,912 DEBUG [Listener at localhost/42383] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-07 10:56:28,917 INFO [Listener at localhost/42383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-07 10:56:28,961 INFO [Listener at localhost/42383] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=246 (was 258), OpenFileDescriptor=634 (was 649), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=240 (was 182) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=9339 (was 9339) 2023-03-07 10:56:28,962 DEBUG [Listener at localhost/42383] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7defec53 to 127.0.0.1:56055 2023-03-07 10:56:28,962 DEBUG [Listener at localhost/42383] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-07 10:56:28,962 INFO [Listener at localhost/42383] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-03-07 10:56:28,963 INFO [Listener at localhost/42383] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-07 10:56:28,963 DEBUG [Listener at localhost/42383] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0629018b to 127.0.0.1:56055 2023-03-07 10:56:28,963 DEBUG [Listener at localhost/42383] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-07 10:56:28,963 DEBUG [Listener at localhost/42383] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-03-07 10:56:28,963 DEBUG [Listener at localhost/42383] util.JVMClusterUtil(257): Found active master hash=143261531, stopped=false 2023-03-07 10:56:28,964 INFO [Listener at localhost/42383] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45579,1678186414835 2023-03-07 10:56:28,965 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-03-07 10:56:28,965 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-03-07 10:56:28,965 INFO [Listener at localhost/42383] procedure2.ProcedureExecutor(629): Stopping 2023-03-07 10:56:28,965 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-07 10:56:28,966 DEBUG [Listener at localhost/42383] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f8b5ed4 to 127.0.0.1:56055 2023-03-07 10:56:28,966 DEBUG [Listener at localhost/42383] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-07 10:56:28,966 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-07 10:56:28,966 INFO [Listener at localhost/42383] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39673,1678186416064' ***** 2023-03-07 10:56:28,966 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-07 10:56:28,966 INFO [Listener at localhost/42383] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-03-07 10:56:28,967 INFO [RS:0;jenkins-hbase4:39673] regionserver.HeapMemoryManager(220): Stopping 2023-03-07 10:56:28,967 INFO [RS:0;jenkins-hbase4:39673] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-03-07 10:56:28,967 INFO [RS:0;jenkins-hbase4:39673] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-03-07 10:56:28,967 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(3304): Received CLOSE for d3470e709599a35cac3d1337722546a9 2023-03-07 10:56:28,968 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(3304): Received CLOSE for 27a4c8afde515956994670de0df3cf30 2023-03-07 10:56:28,968 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(3304): Received CLOSE for 40137ae7c4e46565e6468a174a44ce08 2023-03-07 10:56:28,968 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(3304): Received CLOSE for a8da3ca5bc578b596af4858d20f27e6c 2023-03-07 10:56:28,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d3470e709599a35cac3d1337722546a9, disabling compactions & flushes 2023-03-07 10:56:28,968 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-03-07 10:56:28,968 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:56:28,968 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(3304): Received CLOSE for b443f7ebc46146a5bfe8850837317577 2023-03-07 10:56:28,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:56:28,968 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(3304): Received CLOSE for 96cb7465ccbd98f86b820ce4ec50f4cd 2023-03-07 10:56:28,968 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(3304): Received CLOSE for 0d21772dd37bba3b2c4b78b20a3c30e0 2023-03-07 10:56:28,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. after waiting 0 ms 2023-03-07 10:56:28,968 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(3304): Received CLOSE for dd9504dc3e619e1f536d495d7e8cbf65 2023-03-07 10:56:28,968 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(3304): Received CLOSE for c27a6080404dc0d00435f95e017c7c44 2023-03-07 10:56:28,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:56:28,968 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(3304): Received CLOSE for 0d5f3df3acacfb99246262b2f6eba2c2 2023-03-07 10:56:28,968 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(3304): Received CLOSE for e3ae8109578fdd9db32b92d5f9c631b6 2023-03-07 10:56:28,969 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(3304): Received CLOSE for b608a9e3d8c5353819a8a23fbe06300a 2023-03-07 10:56:28,969 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(3304): Received CLOSE for a270310ad72fe35b8edc286783c8e2c2 2023-03-07 10:56:28,969 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(3304): Received CLOSE for f26513f1f71767bd16ace3f43fa52372 2023-03-07 10:56:28,969 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(3304): Received CLOSE for 8036776dda3d2e3fb58ead3edb012c6e 2023-03-07 10:56:28,969 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(3304): Received CLOSE for e9afcd90942935584307bde41071b5e6 2023-03-07 10:56:28,969 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(3304): Received CLOSE for b1d149d88d390744a8d9cafdd3682b43 2023-03-07 10:56:28,969 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(3304): Received CLOSE for 120edd0de8d32c55588e2c2646d330b6 2023-03-07 10:56:28,969 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(3304): Received CLOSE for 53e5fe74e89a0e6cfd7117280e42010d 2023-03-07 10:56:28,969 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(3304): Received CLOSE for 4376407ee845091c523fcd53b992a700 2023-03-07 10:56:28,969 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:28,969 DEBUG [RS:0;jenkins-hbase4:39673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ad01384 to 127.0.0.1:56055 2023-03-07 10:56:28,969 DEBUG [RS:0;jenkins-hbase4:39673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-07 10:56:28,970 INFO [RS:0;jenkins-hbase4:39673] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-03-07 10:56:28,970 INFO [RS:0;jenkins-hbase4:39673] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-03-07 10:56:28,970 INFO [RS:0;jenkins-hbase4:39673] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-03-07 10:56:28,970 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-03-07 10:56:28,970 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-03-07 10:56:28,970 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-03-07 10:56:28,970 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-03-07 10:56:28,970 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-03-07 10:56:28,970 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-03-07 10:56:28,970 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-03-07 10:56:28,970 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-03-07 10:56:28,971 DEBUG [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(1505): Waiting on 0d21772dd37bba3b2c4b78b20a3c30e0, 0d5f3df3acacfb99246262b2f6eba2c2, 120edd0de8d32c55588e2c2646d330b6, 1588230740, 27a4c8afde515956994670de0df3cf30, 40137ae7c4e46565e6468a174a44ce08, 4376407ee845091c523fcd53b992a700, 53e5fe74e89a0e6cfd7117280e42010d, 8036776dda3d2e3fb58ead3edb012c6e, 96cb7465ccbd98f86b820ce4ec50f4cd, a270310ad72fe35b8edc286783c8e2c2, a8da3ca5bc578b596af4858d20f27e6c, b1d149d88d390744a8d9cafdd3682b43, b443f7ebc46146a5bfe8850837317577, b608a9e3d8c5353819a8a23fbe06300a, c27a6080404dc0d00435f95e017c7c44, d3470e709599a35cac3d1337722546a9, dd9504dc3e619e1f536d495d7e8cbf65, e3ae8109578fdd9db32b92d5f9c631b6, e9afcd90942935584307bde41071b5e6, f26513f1f71767bd16ace3f43fa52372 2023-03-07 10:56:28,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d3470e709599a35cac3d1337722546a9/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-07 10:56:28,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:56:28,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d3470e709599a35cac3d1337722546a9: 2023-03-07 10:56:28,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1678186418898.d3470e709599a35cac3d1337722546a9. 2023-03-07 10:56:28,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 27a4c8afde515956994670de0df3cf30, disabling compactions & flushes 2023-03-07 10:56:28,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:56:28,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:56:28,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. after waiting 0 ms 2023-03-07 10:56:28,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:56:28,979 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-03-07 10:56:28,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/27a4c8afde515956994670de0df3cf30/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-03-07 10:56:28,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:56:28,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 27a4c8afde515956994670de0df3cf30: 2023-03-07 10:56:28,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678186473401.27a4c8afde515956994670de0df3cf30. 2023-03-07 10:56:28,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 40137ae7c4e46565e6468a174a44ce08, disabling compactions & flushes 2023-03-07 10:56:28,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:56:28,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:56:28,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. after waiting 0 ms 2023-03-07 10:56:28,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:56:28,985 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/1588230740/.tmp/info/2cbd5a6acb2a480eb60cfa05eb1f691d 2023-03-07 10:56:28,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithMonthlyPolicy/40137ae7c4e46565e6468a174a44ce08/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-03-07 10:56:28,988 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:56:28,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 40137ae7c4e46565e6468a174a44ce08: 2023-03-07 10:56:28,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1678186432853.40137ae7c4e46565e6468a174a44ce08. 2023-03-07 10:56:28,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a8da3ca5bc578b596af4858d20f27e6c, disabling compactions & flushes 2023-03-07 10:56:28,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. 2023-03-07 10:56:28,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. 2023-03-07 10:56:28,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. after waiting 0 ms 2023-03-07 10:56:28,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. 2023-03-07 10:56:28,990 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2cbd5a6acb2a480eb60cfa05eb1f691d 2023-03-07 10:56:28,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a8da3ca5bc578b596af4858d20f27e6c/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-07 10:56:28,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. 2023-03-07 10:56:28,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a8da3ca5bc578b596af4858d20f27e6c: 2023-03-07 10:56:28,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1678186538733.a8da3ca5bc578b596af4858d20f27e6c. 2023-03-07 10:56:28,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b443f7ebc46146a5bfe8850837317577, disabling compactions & flushes 2023-03-07 10:56:28,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:56:28,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:56:28,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. after waiting 0 ms 2023-03-07 10:56:28,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:56:29,002 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/1588230740/.tmp/rep_barrier/e0d59ac453a04cfeaccfbab767d25f71 2023-03-07 10:56:29,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/b443f7ebc46146a5bfe8850837317577/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-07 10:56:29,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:56:29,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b443f7ebc46146a5bfe8850837317577: 2023-03-07 10:56:29,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1678186510547.b443f7ebc46146a5bfe8850837317577. 2023-03-07 10:56:29,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 96cb7465ccbd98f86b820ce4ec50f4cd, disabling compactions & flushes 2023-03-07 10:56:29,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd. 2023-03-07 10:56:29,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd. 2023-03-07 10:56:29,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd. after waiting 0 ms 2023-03-07 10:56:29,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd. 2023-03-07 10:56:29,006 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e0d59ac453a04cfeaccfbab767d25f71 2023-03-07 10:56:29,008 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/96cb7465ccbd98f86b820ce4ec50f4cd/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-03-07 10:56:29,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd. 2023-03-07 10:56:29,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 96cb7465ccbd98f86b820ce4ec50f4cd: 2023-03-07 10:56:29,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1678186455496.96cb7465ccbd98f86b820ce4ec50f4cd. 2023-03-07 10:56:29,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0d21772dd37bba3b2c4b78b20a3c30e0, disabling compactions & flushes 2023-03-07 10:56:29,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:56:29,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:56:29,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. after waiting 0 ms 2023-03-07 10:56:29,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:56:29,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/0d21772dd37bba3b2c4b78b20a3c30e0/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-07 10:56:29,020 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:56:29,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0d21772dd37bba3b2c4b78b20a3c30e0: 2023-03-07 10:56:29,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1678186510547.0d21772dd37bba3b2c4b78b20a3c30e0. 2023-03-07 10:56:29,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dd9504dc3e619e1f536d495d7e8cbf65, disabling compactions & flushes 2023-03-07 10:56:29,020 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1678186418028.dd9504dc3e619e1f536d495d7e8cbf65. 2023-03-07 10:56:29,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1678186418028.dd9504dc3e619e1f536d495d7e8cbf65. 2023-03-07 10:56:29,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1678186418028.dd9504dc3e619e1f536d495d7e8cbf65. after waiting 0 ms 2023-03-07 10:56:29,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1678186418028.dd9504dc3e619e1f536d495d7e8cbf65. 2023-03-07 10:56:29,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing dd9504dc3e619e1f536d495d7e8cbf65 1/1 column families, dataSize=109 B heapSize=592 B 2023-03-07 10:56:29,050 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-03-07 10:56:29,171 DEBUG [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(1505): Waiting on 0d5f3df3acacfb99246262b2f6eba2c2, 120edd0de8d32c55588e2c2646d330b6, 1588230740, 4376407ee845091c523fcd53b992a700, 53e5fe74e89a0e6cfd7117280e42010d, 8036776dda3d2e3fb58ead3edb012c6e, a270310ad72fe35b8edc286783c8e2c2, b1d149d88d390744a8d9cafdd3682b43, b608a9e3d8c5353819a8a23fbe06300a, c27a6080404dc0d00435f95e017c7c44, dd9504dc3e619e1f536d495d7e8cbf65, e3ae8109578fdd9db32b92d5f9c631b6, e9afcd90942935584307bde41071b5e6, f26513f1f71767bd16ace3f43fa52372 2023-03-07 10:56:29,369 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-03-07 10:56:29,369 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-03-07 10:56:29,371 DEBUG [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(1505): Waiting on 0d5f3df3acacfb99246262b2f6eba2c2, 120edd0de8d32c55588e2c2646d330b6, 1588230740, 4376407ee845091c523fcd53b992a700, 53e5fe74e89a0e6cfd7117280e42010d, 8036776dda3d2e3fb58ead3edb012c6e, a270310ad72fe35b8edc286783c8e2c2, b1d149d88d390744a8d9cafdd3682b43, b608a9e3d8c5353819a8a23fbe06300a, c27a6080404dc0d00435f95e017c7c44, dd9504dc3e619e1f536d495d7e8cbf65, e3ae8109578fdd9db32b92d5f9c631b6, e9afcd90942935584307bde41071b5e6, f26513f1f71767bd16ace3f43fa52372 2023-03-07 10:56:29,422 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/1588230740/.tmp/table/cc2e8bc9e36d422c86e585519603fa6d 2023-03-07 10:56:29,426 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cc2e8bc9e36d422c86e585519603fa6d 2023-03-07 10:56:29,426 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/1588230740/.tmp/info/2cbd5a6acb2a480eb60cfa05eb1f691d as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/1588230740/info/2cbd5a6acb2a480eb60cfa05eb1f691d 2023-03-07 10:56:29,430 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2cbd5a6acb2a480eb60cfa05eb1f691d 2023-03-07 10:56:29,430 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/1588230740/info/2cbd5a6acb2a480eb60cfa05eb1f691d, entries=226, sequenceid=130, filesize=37.9 K 2023-03-07 10:56:29,431 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/1588230740/.tmp/rep_barrier/e0d59ac453a04cfeaccfbab767d25f71 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/1588230740/rep_barrier/e0d59ac453a04cfeaccfbab767d25f71 2023-03-07 10:56:29,434 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e0d59ac453a04cfeaccfbab767d25f71 2023-03-07 10:56:29,434 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/1588230740/rep_barrier/e0d59ac453a04cfeaccfbab767d25f71, entries=1, sequenceid=130, filesize=5.0 K 2023-03-07 10:56:29,434 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/1588230740/.tmp/table/cc2e8bc9e36d422c86e585519603fa6d as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/1588230740/table/cc2e8bc9e36d422c86e585519603fa6d 2023-03-07 10:56:29,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/namespace/dd9504dc3e619e1f536d495d7e8cbf65/.tmp/info/8ef7f3b93d79416a8e5fc6b3bb967450 2023-03-07 10:56:29,438 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cc2e8bc9e36d422c86e585519603fa6d 2023-03-07 10:56:29,438 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/1588230740/table/cc2e8bc9e36d422c86e585519603fa6d, entries=27, sequenceid=130, filesize=6.6 K 2023-03-07 10:56:29,439 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 469ms, sequenceid=130, compaction requested=false 2023-03-07 10:56:29,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/namespace/dd9504dc3e619e1f536d495d7e8cbf65/.tmp/info/8ef7f3b93d79416a8e5fc6b3bb967450 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/namespace/dd9504dc3e619e1f536d495d7e8cbf65/info/8ef7f3b93d79416a8e5fc6b3bb967450 2023-03-07 10:56:29,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/namespace/dd9504dc3e619e1f536d495d7e8cbf65/info/8ef7f3b93d79416a8e5fc6b3bb967450, entries=3, sequenceid=7, filesize=4.8 K 2023-03-07 10:56:29,445 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-03-07 10:56:29,445 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for dd9504dc3e619e1f536d495d7e8cbf65 in 424ms, sequenceid=7, compaction requested=false 2023-03-07 10:56:29,445 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-03-07 10:56:29,446 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-03-07 10:56:29,446 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-03-07 10:56:29,446 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-03-07 10:56:29,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/hbase/namespace/dd9504dc3e619e1f536d495d7e8cbf65/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-03-07 10:56:29,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1678186418028.dd9504dc3e619e1f536d495d7e8cbf65. 2023-03-07 10:56:29,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dd9504dc3e619e1f536d495d7e8cbf65: 2023-03-07 10:56:29,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1678186418028.dd9504dc3e619e1f536d495d7e8cbf65. 2023-03-07 10:56:29,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c27a6080404dc0d00435f95e017c7c44, disabling compactions & flushes 2023-03-07 10:56:29,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. 2023-03-07 10:56:29,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. 2023-03-07 10:56:29,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. after waiting 0 ms 2023-03-07 10:56:29,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. 2023-03-07 10:56:29,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/c27a6080404dc0d00435f95e017c7c44/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-07 10:56:29,453 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. 2023-03-07 10:56:29,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c27a6080404dc0d00435f95e017c7c44: 2023-03-07 10:56:29,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1678186570057.c27a6080404dc0d00435f95e017c7c44. 2023-03-07 10:56:29,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0d5f3df3acacfb99246262b2f6eba2c2, disabling compactions & flushes 2023-03-07 10:56:29,453 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. 2023-03-07 10:56:29,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. 2023-03-07 10:56:29,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. after waiting 0 ms 2023-03-07 10:56:29,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. 2023-03-07 10:56:29,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/0d5f3df3acacfb99246262b2f6eba2c2/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-07 10:56:29,457 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. 2023-03-07 10:56:29,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0d5f3df3acacfb99246262b2f6eba2c2: 2023-03-07 10:56:29,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1678186570057.0d5f3df3acacfb99246262b2f6eba2c2. 2023-03-07 10:56:29,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e3ae8109578fdd9db32b92d5f9c631b6, disabling compactions & flushes 2023-03-07 10:56:29,457 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. 2023-03-07 10:56:29,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. 2023-03-07 10:56:29,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. after waiting 0 ms 2023-03-07 10:56:29,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. 2023-03-07 10:56:29,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionFromAdmin/e3ae8109578fdd9db32b92d5f9c631b6/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-07 10:56:29,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. 2023-03-07 10:56:29,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e3ae8109578fdd9db32b92d5f9c631b6: 2023-03-07 10:56:29,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1678186570057.e3ae8109578fdd9db32b92d5f9c631b6. 2023-03-07 10:56:29,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b608a9e3d8c5353819a8a23fbe06300a, disabling compactions & flushes 2023-03-07 10:56:29,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a. 2023-03-07 10:56:29,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a. 2023-03-07 10:56:29,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a. after waiting 0 ms 2023-03-07 10:56:29,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a. 2023-03-07 10:56:29,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/b608a9e3d8c5353819a8a23fbe06300a/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-03-07 10:56:29,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a. 2023-03-07 10:56:29,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b608a9e3d8c5353819a8a23fbe06300a: 2023-03-07 10:56:29,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1678186455496.b608a9e3d8c5353819a8a23fbe06300a. 2023-03-07 10:56:29,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a270310ad72fe35b8edc286783c8e2c2, disabling compactions & flushes 2023-03-07 10:56:29,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. 2023-03-07 10:56:29,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. 2023-03-07 10:56:29,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. after waiting 0 ms 2023-03-07 10:56:29,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. 2023-03-07 10:56:29,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/a270310ad72fe35b8edc286783c8e2c2/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-07 10:56:29,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. 2023-03-07 10:56:29,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a270310ad72fe35b8edc286783c8e2c2: 2023-03-07 10:56:29,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1678186538733.a270310ad72fe35b8edc286783c8e2c2. 2023-03-07 10:56:29,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f26513f1f71767bd16ace3f43fa52372, disabling compactions & flushes 2023-03-07 10:56:29,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:56:29,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:56:29,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. after waiting 0 ms 2023-03-07 10:56:29,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:56:29,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testCompactionWithHFileLink/f26513f1f71767bd16ace3f43fa52372/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-07 10:56:29,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:56:29,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f26513f1f71767bd16ace3f43fa52372: 2023-03-07 10:56:29,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1678186510547.f26513f1f71767bd16ace3f43fa52372. 2023-03-07 10:56:29,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8036776dda3d2e3fb58ead3edb012c6e, disabling compactions & flushes 2023-03-07 10:56:29,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:56:29,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:56:29,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. after waiting 0 ms 2023-03-07 10:56:29,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:56:29,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithWeeklyPolicy/8036776dda3d2e3fb58ead3edb012c6e/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-07 10:56:29,476 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:56:29,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8036776dda3d2e3fb58ead3edb012c6e: 2023-03-07 10:56:29,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1678186443918.8036776dda3d2e3fb58ead3edb012c6e. 2023-03-07 10:56:29,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e9afcd90942935584307bde41071b5e6, disabling compactions & flushes 2023-03-07 10:56:29,476 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:56:29,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:56:29,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. after waiting 0 ms 2023-03-07 10:56:29,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:56:29,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyPolicy/e9afcd90942935584307bde41071b5e6/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-07 10:56:29,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:56:29,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e9afcd90942935584307bde41071b5e6: 2023-03-07 10:56:29,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1678186460114.e9afcd90942935584307bde41071b5e6. 2023-03-07 10:56:29,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b1d149d88d390744a8d9cafdd3682b43, disabling compactions & flushes 2023-03-07 10:56:29,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:56:29,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:56:29,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. after waiting 0 ms 2023-03-07 10:56:29,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:56:29,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/b1d149d88d390744a8d9cafdd3682b43/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-03-07 10:56:29,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:56:29,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b1d149d88d390744a8d9cafdd3682b43: 2023-03-07 10:56:29,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678186489736.b1d149d88d390744a8d9cafdd3682b43. 2023-03-07 10:56:29,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 120edd0de8d32c55588e2c2646d330b6, disabling compactions & flushes 2023-03-07 10:56:29,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:56:29,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:56:29,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. after waiting 0 ms 2023-03-07 10:56:29,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:56:29,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testMinorCompactionWithMonthlyPolicy/120edd0de8d32c55588e2c2646d330b6/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-03-07 10:56:29,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:56:29,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 120edd0de8d32c55588e2c2646d330b6: 2023-03-07 10:56:29,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1678186557814.120edd0de8d32c55588e2c2646d330b6. 2023-03-07 10:56:29,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 53e5fe74e89a0e6cfd7117280e42010d, disabling compactions & flushes 2023-03-07 10:56:29,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. 2023-03-07 10:56:29,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. 2023-03-07 10:56:29,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. after waiting 0 ms 2023-03-07 10:56:29,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. 2023-03-07 10:56:29,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/ns/testMinorCompaction/53e5fe74e89a0e6cfd7117280e42010d/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-07 10:56:29,492 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. 2023-03-07 10:56:29,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 53e5fe74e89a0e6cfd7117280e42010d: 2023-03-07 10:56:29,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1678186538733.53e5fe74e89a0e6cfd7117280e42010d. 2023-03-07 10:56:29,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4376407ee845091c523fcd53b992a700, disabling compactions & flushes 2023-03-07 10:56:29,492 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700. 2023-03-07 10:56:29,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700. 2023-03-07 10:56:29,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700. after waiting 0 ms 2023-03-07 10:56:29,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700. 2023-03-07 10:56:29,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/data/default/testScannerOnBulkLoadRefHFiles/4376407ee845091c523fcd53b992a700/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-03-07 10:56:29,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700. 2023-03-07 10:56:29,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4376407ee845091c523fcd53b992a700: 2023-03-07 10:56:29,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1678186455496.4376407ee845091c523fcd53b992a700. 2023-03-07 10:56:29,528 DEBUG [regionserver/jenkins-hbase4:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-07 10:56:29,572 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39673,1678186416064; all regions closed. 2023-03-07 10:56:29,578 DEBUG [RS:0;jenkins-hbase4:39673] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/oldWALs 2023-03-07 10:56:29,578 INFO [RS:0;jenkins-hbase4:39673] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39673%2C1678186416064.meta:.meta(num 1678186417721) 2023-03-07 10:56:29,582 DEBUG [RS:0;jenkins-hbase4:39673] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/oldWALs 2023-03-07 10:56:29,582 INFO [RS:0;jenkins-hbase4:39673] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39673%2C1678186416064:(num 1678186417524) 2023-03-07 10:56:29,582 DEBUG [RS:0;jenkins-hbase4:39673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-07 10:56:29,582 INFO [RS:0;jenkins-hbase4:39673] regionserver.LeaseManager(133): Closed leases 2023-03-07 10:56:29,582 INFO [RS:0;jenkins-hbase4:39673] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-03-07 10:56:29,583 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-03-07 10:56:29,584 INFO [RS:0;jenkins-hbase4:39673] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39673 2023-03-07 10:56:29,593 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39673,1678186416064 2023-03-07 10:56:29,593 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-07 10:56:29,593 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-07 10:56:29,593 ERROR [Listener at localhost/42383-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@60514dbe rejected from java.util.concurrent.ThreadPoolExecutor@646ec56c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 533] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-07 10:56:29,595 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39673,1678186416064] 2023-03-07 10:56:29,595 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39673,1678186416064; numProcessing=1 2023-03-07 10:56:29,597 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39673,1678186416064 already deleted, retry=false 2023-03-07 10:56:29,597 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39673,1678186416064 expired; onlineServers=0 2023-03-07 10:56:29,597 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45579,1678186414835' ***** 2023-03-07 10:56:29,597 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-03-07 10:56:29,598 DEBUG [M:0;jenkins-hbase4:45579] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49b4f560, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-03-07 10:56:29,598 INFO [M:0;jenkins-hbase4:45579] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45579,1678186414835 2023-03-07 10:56:29,598 INFO [M:0;jenkins-hbase4:45579] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45579,1678186414835; all regions closed. 2023-03-07 10:56:29,598 DEBUG [M:0;jenkins-hbase4:45579] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-07 10:56:29,598 DEBUG [M:0;jenkins-hbase4:45579] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-03-07 10:56:29,598 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-03-07 10:56:29,598 DEBUG [M:0;jenkins-hbase4:45579] cleaner.HFileCleaner(317): Stopping file delete threads 2023-03-07 10:56:29,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1678186417220] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1678186417220,5,FailOnTimeoutGroup] 2023-03-07 10:56:29,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1678186417220] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1678186417220,5,FailOnTimeoutGroup] 2023-03-07 10:56:29,598 INFO [M:0;jenkins-hbase4:45579] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-03-07 10:56:29,598 INFO [M:0;jenkins-hbase4:45579] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-03-07 10:56:29,598 INFO [M:0;jenkins-hbase4:45579] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-03-07 10:56:29,599 DEBUG [M:0;jenkins-hbase4:45579] master.HMaster(1512): Stopping service threads 2023-03-07 10:56:29,599 INFO [M:0;jenkins-hbase4:45579] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-03-07 10:56:29,599 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-03-07 10:56:29,599 ERROR [M:0;jenkins-hbase4:45579] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT 2023-03-07 10:56:29,599 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-03-07 10:56:29,599 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-07 10:56:29,600 INFO [M:0;jenkins-hbase4:45579] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-03-07 10:56:29,600 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-03-07 10:56:29,600 DEBUG [M:0;jenkins-hbase4:45579] zookeeper.ZKUtil(398): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-03-07 10:56:29,600 WARN [M:0;jenkins-hbase4:45579] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-03-07 10:56:29,600 INFO [M:0;jenkins-hbase4:45579] assignment.AssignmentManager(315): Stopping assignment manager 2023-03-07 10:56:29,600 INFO [M:0;jenkins-hbase4:45579] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-03-07 10:56:29,600 DEBUG [M:0;jenkins-hbase4:45579] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-03-07 10:56:29,601 INFO [M:0;jenkins-hbase4:45579] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-07 10:56:29,601 DEBUG [M:0;jenkins-hbase4:45579] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-07 10:56:29,601 DEBUG [M:0;jenkins-hbase4:45579] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-03-07 10:56:29,601 DEBUG [M:0;jenkins-hbase4:45579] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-07 10:56:29,601 INFO [M:0;jenkins-hbase4:45579] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.50 KB heapSize=598.20 KB 2023-03-07 10:56:29,695 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-07 10:56:29,695 INFO [RS:0;jenkins-hbase4:39673] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39673,1678186416064; zookeeper connection closed. 2023-03-07 10:56:29,695 ERROR [Listener at localhost/42383-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7ad1ebfa rejected from java.util.concurrent.ThreadPoolExecutor@646ec56c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 533] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-07 10:56:29,695 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): regionserver:39673-0x100be9c69520001, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-07 10:56:29,695 ERROR [Listener at localhost/42383-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@250976a rejected from java.util.concurrent.ThreadPoolExecutor@646ec56c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 533] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-07 10:56:29,696 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@fd1e093] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@fd1e093 2023-03-07 10:56:29,696 INFO [Listener at localhost/42383] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-03-07 10:56:30,008 INFO [M:0;jenkins-hbase4:45579] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.50 KB at sequenceid=1005 (bloomFilter=true), to=hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b79311e050684600a88960fc09531d54 2023-03-07 10:56:30,013 INFO [M:0;jenkins-hbase4:45579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b79311e050684600a88960fc09531d54 2023-03-07 10:56:30,014 DEBUG [M:0;jenkins-hbase4:45579] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b79311e050684600a88960fc09531d54 as hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b79311e050684600a88960fc09531d54 2023-03-07 10:56:30,018 INFO [M:0;jenkins-hbase4:45579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b79311e050684600a88960fc09531d54 2023-03-07 10:56:30,018 INFO [M:0;jenkins-hbase4:45579] regionserver.HStore(1080): Added hdfs://localhost:40101/user/jenkins/test-data/3d43ca7d-b711-5dd0-0d1a-a2561826e20f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b79311e050684600a88960fc09531d54, entries=123, sequenceid=1005, filesize=33.3 K 2023-03-07 10:56:30,019 INFO [M:0;jenkins-hbase4:45579] regionserver.HRegion(2948): Finished flush of dataSize ~512.50 KB/524805, heapSize ~598.18 KB/612536, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 418ms, sequenceid=1005, compaction requested=false 2023-03-07 10:56:30,020 INFO [M:0;jenkins-hbase4:45579] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-07 10:56:30,020 DEBUG [M:0;jenkins-hbase4:45579] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-07 10:56:30,022 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-03-07 10:56:30,022 INFO [M:0;jenkins-hbase4:45579] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-03-07 10:56:30,023 INFO [M:0;jenkins-hbase4:45579] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45579 2023-03-07 10:56:30,026 DEBUG [M:0;jenkins-hbase4:45579] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45579,1678186414835 already deleted, retry=false 2023-03-07 10:56:30,128 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-07 10:56:30,128 INFO [M:0;jenkins-hbase4:45579] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45579,1678186414835; zookeeper connection closed. 2023-03-07 10:56:30,128 ERROR [Listener at localhost/42383-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3ef4d39a rejected from java.util.concurrent.ThreadPoolExecutor@68799a52[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-07 10:56:30,128 DEBUG [Listener at localhost/42383-EventThread] zookeeper.ZKWatcher(600): master:45579-0x100be9c69520000, quorum=127.0.0.1:56055, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-07 10:56:30,128 ERROR [Listener at localhost/42383-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4f02991a rejected from java.util.concurrent.ThreadPoolExecutor@68799a52[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-07 10:56:30,130 WARN [Listener at localhost/42383] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-03-07 10:56:30,133 INFO [Listener at localhost/42383] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-03-07 10:56:30,238 WARN [BP-764243538-172.31.14.131-1678186411446 heartbeating to localhost/127.0.0.1:40101] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-03-07 10:56:30,238 WARN [BP-764243538-172.31.14.131-1678186411446 heartbeating to localhost/127.0.0.1:40101] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-764243538-172.31.14.131-1678186411446 (Datanode Uuid 4bca1348-168b-4ef4-97fa-db6f7dc39f86) service to localhost/127.0.0.1:40101 2023-03-07 10:56:30,240 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/cluster_071bbff6-8e10-d123-7f15-b1e31d2cd3b7/dfs/data/data1/current/BP-764243538-172.31.14.131-1678186411446] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-03-07 10:56:30,241 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c5ca2223-5614-202d-4c23-43e3c2821eec/cluster_071bbff6-8e10-d123-7f15-b1e31d2cd3b7/dfs/data/data2/current/BP-764243538-172.31.14.131-1678186411446] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-03-07 10:56:30,268 INFO [Listener at localhost/42383] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-03-07 10:56:30,401 INFO [Listener at localhost/42383] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-03-07 10:56:30,491 INFO [Listener at localhost/42383] hbase.HBaseTestingUtility(1293): Minicluster is down